2023-04-14 12:55:39,101 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-14 12:55:39,470 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-14 12:55:39,596 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-14 12:55:39,679 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-14 12:55:39,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-14 12:55:39,704 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=169, AvailableMemoryMB=1936
2023-04-14 12:55:39,707 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-14 12:55:39,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-14 12:55:39,881 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1017193007:84 , srv1036295055:84 , srv1039971535:84 , srv1055480194:84 , srv1086624111:84 , srv109625773:84 , srv1152039217:84 , srv1164988831:84 , srv1188127335:84 , srv119400731:84 , srv1199999792:84 , srv1203610136:84 , srv12281448:84 , srv1241470971:84 , srv1242680956:84 , srv1267187714:84 , srv1275239211:84 , srv1277279762:84 , srv1295487254:84 , srv1301805000:84 , srv1322652952:84 , srv1358648975:84 , srv1360348924:84 , srv1425662090:84 , srv1501554785:84 , srv1504843935:84 , srv1590112846:84 , srv1591742537:84 , srv1596329475:84 , srv1598479845:84 , srv1630070213:84 , srv165188908:84 , srv1690329001:84 , srv1699193304:84 , srv170811319:84 , srv1713838164:84 , srv1742097520:84 , srv1794885725:84 , srv1834822163:84 , srv1844804856:84 , srv1845434041:84 , srv18564453:84 , srv1867653161:84 , srv1880851584:84 , srv1884663899:84 , srv1908943523:84 , srv1991327133:84 , srv2007682052:84 , srv2008250863:84 , srv2011273899:84 , srv2023353508:84 , srv2023622830:84 , srv2026125598:84 , srv2056734633:84 , srv2112177924:84 , srv2128743812:84 , srv2131767514:84 , srv2145571838:84 , srv218973895:84 , srv223435547:84 , srv233537579:84 , srv253360441:84 , srv277571458:84 , srv285957752:84 , srv301263303:84 , srv310698328:84 , srv336287182:84 , srv341917318:84 , srv374015036:84 , srv379524581:84 , srv391339966:84 , srv422183840:84 , srv428000750:84 , srv44302559:84 , srv445590705:84 , srv494674666:84 , srv550706024:84 , srv558483660:84 , srv562720721:84 , srv569208229:84 , srv586771952:84 , srv587660007:84 , srv590085627:84 , srv597300348:84 , srv614812136:84 , srv634652664:84 , srv636087525:84 , srv760465454:84 , srv829957498:84 , srv832079200:84 , srv832193815:84 , srv851080518:84 , srv851424097:84 , srv855236688:84 , srv861843231:84 , srv896041996:84 , srv919891547:84 , srv932603919:84 , srv956504890:84 , srv1092064771:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-14 12:55:39,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:39,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374015036=69, srv2112177924=55, srv1092064771=5, srv170811319=35, srv109625773=6, srv12281448=13, srv119400731=10, srv1699193304=34, srv861843231=95, srv1055480194=3, srv2128743812=56, srv1039971535=2, srv1591742537=28, srv391339966=71, srv1358648975=22, srv2023353508=51, srv587660007=82, srv1295487254=19, srv586771952=81, srv44302559=74, srv1199999792=11, srv1834822163=39, srv550706024=77, srv1152039217=7, srv1277279762=18, srv1794885725=38, srv1242680956=15, srv1908943523=46, srv1275239211=17, srv1845434041=41, srv1713838164=36, srv597300348=84, srv562720721=79, srv494674666=76, srv2145571838=58, srv851424097=93, srv310698328=66, srv614812136=85, srv932603919=98, srv1690329001=33, srv2008250863=49, srv1742097520=37, srv165188908=32, srv422183840=72, srv2026125598=53, srv851080518=92, srv919891547=97, srv832193815=91, srv1267187714=16, srv1880851584=44, srv1188127335=9, srv2131767514=57, srv636087525=87, srv956504890=99, srv1501554785=25, srv428000750=73, srv1203610136=12, srv590085627=83, srv1867653161=43, srv2023622830=52, srv2011273899=50, srv233537579=61, srv634652664=86, srv855236688=94, srv445590705=75, srv1504843935=26, srv1425662090=24, srv896041996=96, srv1301805000=20, srv1630070213=31, srv2007682052=48, srv301263303=65, srv1590112846=27, srv1360348924=23, srv1241470971=14, srv1844804856=40, srv1322652952=21, srv1164988831=8, srv1991327133=47, srv218973895=59, srv336287182=67, srv379524581=70, srv569208229=80, srv277571458=63, srv285957752=64, srv1596329475=29, srv1598479845=30, srv1017193007=0, srv223435547=60, srv18564453=42, srv2056734633=54, srv558483660=78, srv760465454=88, srv253360441=62, srv341917318=68, srv832079200=90, srv1884663899=45, srv1036295055=1, srv1086624111=4, srv829957498=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:40,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:40,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:40,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:40,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:40,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:40,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:40,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:40,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:40,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:40,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:40,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:40,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:40,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:40,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:40,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:40,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:40,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:40,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:40,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:40,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 12:55:40,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 12:55:40,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 12:55:40,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 12:55:40,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 12:55:40,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 12:55:40,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 12:55:40,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 12:55:40,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 12:55:40,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 12:55:40,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 12:55:40,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 12:55:40,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 12:55:40,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 12:55:40,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 12:55:40,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 12:55:40,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 12:55:40,330 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:40,331 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 12:55:40,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 12:55:41,311 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1204 ms to try 5000 different iterations.  Found a solution that moves 4690 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18195879601014636. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03828079973541032, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05461835756561143, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5211111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03828079973541032, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:41,356 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv165188908:79 , srv285957752:82 , srv310698328:82 , srv109625773:83 , srv1164988831:83 , srv1504843935:83 , srv1991327133:83 , srv2007682052:83 , srv233537579:83 , srv44302559:83 , srv445590705:83 , srv590085627:83 , srv832079200:83 , srv1275239211:84 , srv1425662090:84 , srv2023622830:84 , srv218973895:84 , srv223435547:84 , srv336287182:84 , srv379524581:84 , srv586771952:84 , srv597300348:84 , srv829957498:84 , srv851080518:84 , srv1241470971:85 , srv1590112846:85 , srv1699193304:85 , srv2023353508:85 , srv341917318:85 , srv569208229:85 , srv587660007:85 , srv832193815:85 , srv956504890:85 , srv1039971535:86 , srv1055480194:86 , srv119400731:86 , srv1295487254:86 , srv1358648975:86 , srv1591742537:86 , srv170811319:86 , srv1713838164:86 , srv18564453:86 , srv1884663899:86 , srv1908943523:86 , srv2056734633:86 , srv2145571838:86 , srv277571458:86 , srv374015036:86 , srv558483660:86 , srv851424097:86 , srv861843231:86 , srv1188127335:87 , srv1203610136:87 , srv1242680956:87 , srv1277279762:87 , srv1301805000:87 , srv1322652952:87 , srv1360348924:87 , srv1596329475:87 , srv1598479845:87 , srv1834822163:87 , srv253360441:87 , srv391339966:87 , srv422183840:87 , srv550706024:87 , srv562720721:87 , srv919891547:87 , srv12281448:88 , srv1501554785:88 , srv1630070213:88 , srv1742097520:88 , srv1844804856:88 , srv2008250863:88 , srv2011273899:88 , srv2128743812:88 , srv2131767514:88 , srv494674666:88 , srv634652664:88 , srv855236688:88 , srv1017193007:89 , srv1086624111:89 , srv1690329001:89 , srv1794885725:89 , srv2112177924:89 , srv301263303:89 , srv636087525:89 , srv896041996:89 , srv1152039217:90 , srv1845434041:90 , srv760465454:90 , srv932603919:90 , srv2026125598:91 , srv428000750:91 , srv1036295055:92 , srv1199999792:92 , srv1867653161:92 , srv1267187714:93 , srv1880851584:94 , srv614812136:95 , srv1092064771:430 }
2023-04-14 12:55:41,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:41,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374015036=69, srv2112177924=55, srv1092064771=5, srv170811319=35, srv109625773=6, srv12281448=13, srv119400731=10, srv1699193304=34, srv861843231=95, srv1055480194=3, srv2128743812=56, srv1039971535=2, srv1591742537=28, srv391339966=71, srv1358648975=22, srv2023353508=51, srv587660007=82, srv1295487254=19, srv586771952=81, srv44302559=74, srv1199999792=11, srv1834822163=39, srv550706024=77, srv1152039217=7, srv1277279762=18, srv1794885725=38, srv1242680956=15, srv1908943523=46, srv1275239211=17, srv1845434041=41, srv1713838164=36, srv597300348=84, srv562720721=79, srv494674666=76, srv2145571838=58, srv851424097=93, srv310698328=66, srv614812136=85, srv932603919=98, srv1690329001=33, srv2008250863=49, srv1742097520=37, srv165188908=32, srv422183840=72, srv2026125598=53, srv851080518=92, srv919891547=97, srv832193815=91, srv1267187714=16, srv1880851584=44, srv1188127335=9, srv2131767514=57, srv636087525=87, srv956504890=99, srv1501554785=25, srv428000750=73, srv1203610136=12, srv590085627=83, srv1867653161=43, srv2023622830=52, srv2011273899=50, srv233537579=61, srv634652664=86, srv855236688=94, srv445590705=75, srv1504843935=26, srv1425662090=24, srv896041996=96, srv1301805000=20, srv1630070213=31, srv2007682052=48, srv301263303=65, srv1590112846=27, srv1360348924=23, srv1241470971=14, srv1844804856=40, srv1322652952=21, srv1164988831=8, srv1991327133=47, srv218973895=59, srv336287182=67, srv379524581=70, srv569208229=80, srv277571458=63, srv285957752=64, srv1596329475=29, srv1598479845=30, srv1017193007=0, srv223435547=60, srv18564453=42, srv2056734633=54, srv558483660=78, srv760465454=88, srv253360441=62, srv341917318=68, srv832079200=90, srv1884663899=45, srv1036295055=1, srv1086624111=4, srv829957498=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:41,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:41,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:41,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:41,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:41,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:41,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:41,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:41,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:41,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:41,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 12:55:41,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 12:55:41,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 12:55:41,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 12:55:41,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 12:55:41,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 12:55:41,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 12:55:41,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 12:55:41,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 12:55:41,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 12:55:41,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 12:55:41,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 12:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 12:55:41,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 12:55:41,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 12:55:41,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 12:55:41,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 12:55:41,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 12:55:41,627 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03828079973541032, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05461835756561143, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03828079973541032, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:41,627 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 12:55:41,628 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18192595592824123, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03828079973541032, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05461835756561143, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03828079973541032, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 12:55:42,006 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 545 ms to try 5000 different iterations.  Found a solution that moves 2703 regions; Going from a computed imbalance of 0.18192595592824123 to a new imbalance of 0.01616433257187957. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018918903992972178); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03152324423418789, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30033333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018918903992972178); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:42,021 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv614812136:76 , srv1267187714:78 , srv1036295055:79 , srv1199999792:80 , srv1867653161:80 , srv1880851584:80 , srv1152039217:81 , srv2026125598:81 , srv428000750:81 , srv636087525:81 , srv1845434041:82 , srv760465454:82 , srv12281448:83 , srv2011273899:83 , srv2128743812:83 , srv2131767514:83 , srv301263303:83 , srv932603919:83 , srv1086624111:84 , srv1295487254:84 , srv1690329001:84 , srv2112177924:84 , srv253360441:84 , srv494674666:84 , srv550706024:84 , srv562720721:84 , srv634652664:84 , srv855236688:84 , srv1017193007:85 , srv1277279762:85 , srv1358648975:85 , srv1596329475:85 , srv1630070213:85 , srv1834822163:85 , srv1844804856:85 , srv1884663899:85 , srv277571458:85 , srv391339966:85 , srv422183840:85 , srv861843231:85 , srv1055480194:86 , srv1188127335:86 , srv119400731:86 , srv1241470971:86 , srv1301805000:86 , srv1360348924:86 , srv1598479845:86 , srv1794885725:86 , srv2023353508:86 , srv2056734633:86 , srv374015036:86 , srv558483660:86 , srv586771952:86 , srv851424097:86 , srv896041996:86 , srv919891547:86 , srv956504890:86 , srv1203610136:87 , srv1275239211:87 , srv1322652952:87 , srv1425662090:87 , srv1501554785:87 , srv1591742537:87 , srv1699193304:87 , srv170811319:87 , srv1713838164:87 , srv218973895:87 , srv336287182:87 , srv569208229:87 , srv587660007:87 , srv1039971535:88 , srv109625773:88 , srv1504843935:88 , srv1590112846:88 , srv1742097520:88 , srv18564453:88 , srv1908943523:88 , srv2007682052:88 , srv2008250863:88 , srv2023622830:88 , srv2145571838:88 , srv223435547:88 , srv233537579:88 , srv310698328:88 , srv379524581:88 , srv590085627:88 , srv597300348:88 , srv829957498:88 , srv851080518:88 , srv832079200:89 , srv1164988831:90 , srv1242680956:90 , srv1991327133:90 , srv285957752:90 , srv341917318:90 , srv832193815:90 , srv44302559:91 , srv445590705:91 , srv165188908:93 , srv1092064771:512 }
2023-04-14 12:55:42,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:42,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374015036=69, srv2112177924=55, srv1092064771=5, srv170811319=35, srv109625773=6, srv12281448=13, srv119400731=10, srv1699193304=34, srv861843231=95, srv1055480194=3, srv2128743812=56, srv1039971535=2, srv1591742537=28, srv391339966=71, srv1358648975=22, srv2023353508=51, srv587660007=82, srv1295487254=19, srv586771952=81, srv44302559=74, srv1199999792=11, srv1834822163=39, srv550706024=77, srv1152039217=7, srv1277279762=18, srv1794885725=38, srv1242680956=15, srv1908943523=46, srv1275239211=17, srv1845434041=41, srv1713838164=36, srv597300348=84, srv562720721=79, srv494674666=76, srv2145571838=58, srv851424097=93, srv310698328=66, srv614812136=85, srv932603919=98, srv1690329001=33, srv2008250863=49, srv1742097520=37, srv165188908=32, srv422183840=72, srv2026125598=53, srv851080518=92, srv919891547=97, srv832193815=91, srv1267187714=16, srv1880851584=44, srv1188127335=9, srv2131767514=57, srv636087525=87, srv956504890=99, srv1501554785=25, srv428000750=73, srv1203610136=12, srv590085627=83, srv1867653161=43, srv2023622830=52, srv2011273899=50, srv233537579=61, srv634652664=86, srv855236688=94, srv445590705=75, srv1504843935=26, srv1425662090=24, srv896041996=96, srv1301805000=20, srv1630070213=31, srv2007682052=48, srv301263303=65, srv1590112846=27, srv1360348924=23, srv1241470971=14, srv1844804856=40, srv1322652952=21, srv1164988831=8, srv1991327133=47, srv218973895=59, srv336287182=67, srv379524581=70, srv569208229=80, srv277571458=63, srv285957752=64, srv1596329475=29, srv1598479845=30, srv1017193007=0, srv223435547=60, srv18564453=42, srv2056734633=54, srv558483660=78, srv760465454=88, srv253360441=62, srv341917318=68, srv832079200=90, srv1884663899=45, srv1036295055=1, srv1086624111=4, srv829957498=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:42,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:42,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:42,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:42,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 12:55:42,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 12:55:42,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 12:55:42,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 12:55:42,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 12:55:42,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 12:55:42,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 12:55:42,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 12:55:42,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 12:55:42,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 12:55:42,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 12:55:42,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018918903992972178); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03152324423418789, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018918903992972178); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:42,202 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 12:55:42,203 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01614540576134874, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018918903992972178); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03152324423418789, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018918903992972178); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 12:55:42,530 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 447 ms to try 5000 different iterations.  Found a solution that moves 984 regions; Going from a computed imbalance of 0.01614540576134874 to a new imbalance of 6.654439510923213E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004865057721317353); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009428090415820633); MoveCostFunction : (multiplier=7.0, imbalance=0.10933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004865057721317353); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:42,532 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1242680956:81 , srv1501554785:82 , srv1742097520:82 , srv1794885725:82 , srv2008250863:82 , srv896041996:82 , srv1203610136:83 , srv1322652952:83 , srv341917318:83 , srv445590705:83 , srv832193815:83 , srv1017193007:84 , srv1039971535:84 , srv1055480194:84 , srv1086624111:84 , srv1164988831:84 , srv1188127335:84 , srv1360348924:84 , srv1690329001:84 , srv170811319:84 , srv1844804856:84 , srv18564453:84 , srv1880851584:84 , srv1991327133:84 , srv2145571838:84 , srv44302559:84 , srv932603919:84 , srv1277279762:85 , srv1301805000:85 , srv1590112846:85 , srv1591742537:85 , srv1596329475:85 , srv1598479845:85 , srv1630070213:85 , srv1713838164:85 , srv1845434041:85 , srv1867653161:85 , srv1908943523:85 , srv2026125598:85 , srv2112177924:85 , srv223435547:85 , srv285957752:85 , srv374015036:85 , srv379524581:85 , srv428000750:85 , srv558483660:85 , srv634652664:85 , srv851080518:85 , srv855236688:85 , srv919891547:85 , srv1036295055:86 , srv109625773:86 , srv119400731:86 , srv1199999792:86 , srv12281448:86 , srv1275239211:86 , srv1358648975:86 , srv1504843935:86 , srv165188908:86 , srv1699193304:86 , srv1834822163:86 , srv2011273899:86 , srv2023622830:86 , srv2056734633:86 , srv2128743812:86 , srv2131767514:86 , srv301263303:86 , srv336287182:86 , srv391339966:86 , srv422183840:86 , srv494674666:86 , srv587660007:86 , srv590085627:86 , srv597300348:86 , srv614812136:86 , srv760465454:86 , srv829957498:86 , srv832079200:86 , srv851424097:86 , srv1152039217:87 , srv1241470971:87 , srv1267187714:87 , srv1295487254:87 , srv1425662090:87 , srv1884663899:87 , srv2007682052:87 , srv2023353508:87 , srv218973895:87 , srv233537579:87 , srv253360441:87 , srv277571458:87 , srv550706024:87 , srv562720721:87 , srv569208229:87 , srv586771952:87 , srv861843231:87 , srv956504890:87 , srv310698328:88 , srv636087525:88 , srv1092064771:559 }
2023-04-14 12:55:42,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:42,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374015036=69, srv2112177924=55, srv1092064771=5, srv170811319=35, srv109625773=6, srv12281448=13, srv119400731=10, srv1699193304=34, srv861843231=95, srv1055480194=3, srv2128743812=56, srv1039971535=2, srv1591742537=28, srv391339966=71, srv1358648975=22, srv2023353508=51, srv587660007=82, srv1295487254=19, srv586771952=81, srv44302559=74, srv1199999792=11, srv1834822163=39, srv550706024=77, srv1152039217=7, srv1277279762=18, srv1794885725=38, srv1242680956=15, srv1908943523=46, srv1275239211=17, srv1845434041=41, srv1713838164=36, srv597300348=84, srv562720721=79, srv494674666=76, srv2145571838=58, srv851424097=93, srv310698328=66, srv614812136=85, srv932603919=98, srv1690329001=33, srv2008250863=49, srv1742097520=37, srv165188908=32, srv422183840=72, srv2026125598=53, srv851080518=92, srv919891547=97, srv832193815=91, srv1267187714=16, srv1880851584=44, srv1188127335=9, srv2131767514=57, srv636087525=87, srv956504890=99, srv1501554785=25, srv428000750=73, srv1203610136=12, srv590085627=83, srv1867653161=43, srv2023622830=52, srv2011273899=50, srv233537579=61, srv634652664=86, srv855236688=94, srv445590705=75, srv1504843935=26, srv1425662090=24, srv896041996=96, srv1301805000=20, srv1630070213=31, srv2007682052=48, srv301263303=65, srv1590112846=27, srv1360348924=23, srv1241470971=14, srv1844804856=40, srv1322652952=21, srv1164988831=8, srv1991327133=47, srv218973895=59, srv336287182=67, srv379524581=70, srv569208229=80, srv277571458=63, srv285957752=64, srv1596329475=29, srv1598479845=30, srv1017193007=0, srv223435547=60, srv18564453=42, srv2056734633=54, srv558483660=78, srv760465454=88, srv253360441=62, srv341917318=68, srv832079200=90, srv1884663899=45, srv1036295055=1, srv1086624111=4, srv829957498=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:42,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:42,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:42,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:42,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 12:55:42,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 12:55:42,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 12:55:42,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 12:55:42,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 12:55:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 12:55:42,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 12:55:42,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 12:55:42,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 12:55:42,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004865057721317353); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009428090415820633); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004865057721317353); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:42,733 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 12:55:42,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.585538358269349E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004865057721317353); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009428090415820633); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004865057721317353); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 12:55:43,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 499 ms to try 5000 different iterations.  Found a solution that moves 219 regions; Going from a computed imbalance of 6.585538358269349E-4 to a new imbalance of 3.3883273435845425E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.024333333333333332); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:43,096 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv119400731:83 , srv233537579:83 , srv569208229:83 , srv1017193007:84 , srv1036295055:84 , srv1039971535:84 , srv1152039217:84 , srv1241470971:84 , srv1242680956:84 , srv1267187714:84 , srv1301805000:84 , srv1322652952:84 , srv1425662090:84 , srv1501554785:84 , srv1590112846:84 , srv1591742537:84 , srv1598479845:84 , srv1630070213:84 , srv165188908:84 , srv1699193304:84 , srv1713838164:84 , srv1742097520:84 , srv1834822163:84 , srv18564453:84 , srv1880851584:84 , srv1884663899:84 , srv1908943523:84 , srv2007682052:84 , srv2008250863:84 , srv2023353508:84 , srv2056734633:84 , srv2112177924:84 , srv2145571838:84 , srv218973895:84 , srv253360441:84 , srv277571458:84 , srv301263303:84 , srv310698328:84 , srv341917318:84 , srv391339966:84 , srv422183840:84 , srv44302559:84 , srv494674666:84 , srv550706024:84 , srv562720721:84 , srv587660007:84 , srv597300348:84 , srv614812136:84 , srv636087525:84 , srv760465454:84 , srv829957498:84 , srv832079200:84 , srv832193815:84 , srv851424097:84 , srv861843231:84 , srv919891547:84 , srv956504890:84 , srv1086624111:85 , srv109625773:85 , srv1164988831:85 , srv1188127335:85 , srv1199999792:85 , srv1203610136:85 , srv12281448:85 , srv1275239211:85 , srv1277279762:85 , srv1295487254:85 , srv1358648975:85 , srv1360348924:85 , srv1504843935:85 , srv1596329475:85 , srv1690329001:85 , srv170811319:85 , srv1794885725:85 , srv1845434041:85 , srv1867653161:85 , srv1991327133:85 , srv2011273899:85 , srv2023622830:85 , srv2026125598:85 , srv2128743812:85 , srv2131767514:85 , srv285957752:85 , srv336287182:85 , srv374015036:85 , srv379524581:85 , srv428000750:85 , srv445590705:85 , srv558483660:85 , srv586771952:85 , srv590085627:85 , srv634652664:85 , srv855236688:85 , srv896041996:85 , srv932603919:85 , srv1055480194:86 , srv1844804856:86 , srv223435547:86 , srv851080518:86 , srv1092064771:641 }
2023-04-14 12:55:43,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:43,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374015036=69, srv2112177924=55, srv1092064771=5, srv170811319=35, srv109625773=6, srv12281448=13, srv119400731=10, srv1699193304=34, srv861843231=95, srv1055480194=3, srv2128743812=56, srv1039971535=2, srv1591742537=28, srv391339966=71, srv1358648975=22, srv2023353508=51, srv587660007=82, srv1295487254=19, srv586771952=81, srv44302559=74, srv1199999792=11, srv1834822163=39, srv550706024=77, srv1152039217=7, srv1277279762=18, srv1794885725=38, srv1242680956=15, srv1908943523=46, srv1275239211=17, srv1845434041=41, srv1713838164=36, srv597300348=84, srv562720721=79, srv494674666=76, srv2145571838=58, srv851424097=93, srv310698328=66, srv614812136=85, srv932603919=98, srv1690329001=33, srv2008250863=49, srv1742097520=37, srv165188908=32, srv422183840=72, srv2026125598=53, srv851080518=92, srv919891547=97, srv832193815=91, srv1267187714=16, srv1880851584=44, srv1188127335=9, srv2131767514=57, srv636087525=87, srv956504890=99, srv1501554785=25, srv428000750=73, srv1203610136=12, srv590085627=83, srv1867653161=43, srv2023622830=52, srv2011273899=50, srv233537579=61, srv634652664=86, srv855236688=94, srv445590705=75, srv1504843935=26, srv1425662090=24, srv896041996=96, srv1301805000=20, srv1630070213=31, srv2007682052=48, srv301263303=65, srv1590112846=27, srv1360348924=23, srv1241470971=14, srv1844804856=40, srv1322652952=21, srv1164988831=8, srv1991327133=47, srv218973895=59, srv336287182=67, srv379524581=70, srv569208229=80, srv277571458=63, srv285957752=64, srv1596329475=29, srv1598479845=30, srv1017193007=0, srv223435547=60, srv18564453=42, srv2056734633=54, srv558483660=78, srv760465454=88, srv253360441=62, srv341917318=68, srv832079200=90, srv1884663899=45, srv1036295055=1, srv1086624111=4, srv829957498=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:43,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:43,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:43,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:43,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:43,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:43,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:43,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 12:55:43,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 12:55:43,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 12:55:43,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 12:55:43,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 12:55:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 12:55:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 12:55:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 12:55:43,251 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:43,252 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 12:55:43,252 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.234980266031734E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 12:55:43,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 375 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 3.234980266031734E-5 to a new imbalance of 6.200130331567064E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:43,516 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1199999792:83 , srv1844804856:83 , srv1908943523:83 , srv2023622830:83 , srv223435547:83 , srv851080518:83 , srv1017193007:84 , srv1039971535:84 , srv1055480194:84 , srv1086624111:84 , srv109625773:84 , srv1152039217:84 , srv1164988831:84 , srv1188127335:84 , srv1203610136:84 , srv12281448:84 , srv1241470971:84 , srv1242680956:84 , srv1267187714:84 , srv1275239211:84 , srv1277279762:84 , srv1295487254:84 , srv1301805000:84 , srv1358648975:84 , srv1360348924:84 , srv1425662090:84 , srv1504843935:84 , srv1590112846:84 , srv1591742537:84 , srv1596329475:84 , srv1598479845:84 , srv1630070213:84 , srv165188908:84 , srv1690329001:84 , srv1699193304:84 , srv170811319:84 , srv1713838164:84 , srv1742097520:84 , srv1794885725:84 , srv1834822163:84 , srv1845434041:84 , srv18564453:84 , srv1867653161:84 , srv1880851584:84 , srv1884663899:84 , srv1991327133:84 , srv2007682052:84 , srv2008250863:84 , srv2011273899:84 , srv2023353508:84 , srv2026125598:84 , srv2056734633:84 , srv2112177924:84 , srv2128743812:84 , srv2131767514:84 , srv2145571838:84 , srv218973895:84 , srv253360441:84 , srv277571458:84 , srv285957752:84 , srv301263303:84 , srv310698328:84 , srv336287182:84 , srv341917318:84 , srv374015036:84 , srv379524581:84 , srv391339966:84 , srv422183840:84 , srv428000750:84 , srv44302559:84 , srv445590705:84 , srv494674666:84 , srv550706024:84 , srv558483660:84 , srv562720721:84 , srv569208229:84 , srv586771952:84 , srv587660007:84 , srv590085627:84 , srv597300348:84 , srv634652664:84 , srv636087525:84 , srv760465454:84 , srv829957498:84 , srv832079200:84 , srv832193815:84 , srv851424097:84 , srv855236688:84 , srv861843231:84 , srv896041996:84 , srv919891547:84 , srv932603919:84 , srv956504890:84 , srv1036295055:85 , srv119400731:85 , srv1322652952:85 , srv1501554785:85 , srv233537579:85 , srv614812136:85 , srv1092064771:684 }
2023-04-14 12:55:43,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:43,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374015036=69, srv2112177924=55, srv1092064771=5, srv170811319=35, srv109625773=6, srv12281448=13, srv119400731=10, srv1699193304=34, srv861843231=95, srv1055480194=3, srv2128743812=56, srv1039971535=2, srv1591742537=28, srv391339966=71, srv1358648975=22, srv2023353508=51, srv587660007=82, srv1295487254=19, srv586771952=81, srv44302559=74, srv1199999792=11, srv1834822163=39, srv550706024=77, srv1152039217=7, srv1277279762=18, srv1794885725=38, srv1242680956=15, srv1908943523=46, srv1275239211=17, srv1845434041=41, srv1713838164=36, srv597300348=84, srv562720721=79, srv494674666=76, srv2145571838=58, srv851424097=93, srv310698328=66, srv614812136=85, srv932603919=98, srv1690329001=33, srv2008250863=49, srv1742097520=37, srv165188908=32, srv422183840=72, srv2026125598=53, srv851080518=92, srv919891547=97, srv832193815=91, srv1267187714=16, srv1880851584=44, srv1188127335=9, srv2131767514=57, srv636087525=87, srv956504890=99, srv1501554785=25, srv428000750=73, srv1203610136=12, srv590085627=83, srv1867653161=43, srv2023622830=52, srv2011273899=50, srv233537579=61, srv634652664=86, srv855236688=94, srv445590705=75, srv1504843935=26, srv1425662090=24, srv896041996=96, srv1301805000=20, srv1630070213=31, srv2007682052=48, srv301263303=65, srv1590112846=27, srv1360348924=23, srv1241470971=14, srv1844804856=40, srv1322652952=21, srv1164988831=8, srv1991327133=47, srv218973895=59, srv336287182=67, srv379524581=70, srv569208229=80, srv277571458=63, srv285957752=64, srv1596329475=29, srv1598479845=30, srv1017193007=0, srv223435547=60, srv18564453=42, srv2056734633=54, srv558483660=78, srv760465454=88, srv253360441=62, srv341917318=68, srv832079200=90, srv1884663899=45, srv1036295055=1, srv1086624111=4, srv829957498=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:43,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:43,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:43,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 12:55:43,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 12:55:43,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 12:55:43,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 12:55:43,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 12:55:43,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 12:55:43,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 12:55:43,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 12:55:43,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 12:55:43,663 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:43,663 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1199999792:83 , srv1844804856:83 , srv1908943523:83 , srv2023622830:83 , srv223435547:83 , srv851080518:83 , srv1017193007:84 , srv1039971535:84 , srv1055480194:84 , srv1086624111:84 , srv109625773:84 , srv1152039217:84 , srv1164988831:84 , srv1188127335:84 , srv1203610136:84 , srv12281448:84 , srv1241470971:84 , srv1242680956:84 , srv1267187714:84 , srv1275239211:84 , srv1277279762:84 , srv1295487254:84 , srv1301805000:84 , srv1358648975:84 , srv1360348924:84 , srv1425662090:84 , srv1504843935:84 , srv1590112846:84 , srv1591742537:84 , srv1596329475:84 , srv1598479845:84 , srv1630070213:84 , srv165188908:84 , srv1690329001:84 , srv1699193304:84 , srv170811319:84 , srv1713838164:84 , srv1742097520:84 , srv1794885725:84 , srv1834822163:84 , srv1845434041:84 , srv18564453:84 , srv1867653161:84 , srv1880851584:84 , srv1884663899:84 , srv1991327133:84 , srv2007682052:84 , srv2008250863:84 , srv2011273899:84 , srv2023353508:84 , srv2026125598:84 , srv2056734633:84 , srv2112177924:84 , srv2128743812:84 , srv2131767514:84 , srv2145571838:84 , srv218973895:84 , srv253360441:84 , srv277571458:84 , srv285957752:84 , srv301263303:84 , srv310698328:84 , srv336287182:84 , srv341917318:84 , srv374015036:84 , srv379524581:84 , srv391339966:84 , srv422183840:84 , srv428000750:84 , srv44302559:84 , srv445590705:84 , srv494674666:84 , srv550706024:84 , srv558483660:84 , srv562720721:84 , srv569208229:84 , srv586771952:84 , srv587660007:84 , srv590085627:84 , srv597300348:84 , srv634652664:84 , srv636087525:84 , srv760465454:84 , srv829957498:84 , srv832079200:84 , srv832193815:84 , srv851424097:84 , srv855236688:84 , srv861843231:84 , srv896041996:84 , srv919891547:84 , srv932603919:84 , srv956504890:84 , srv1036295055:85 , srv119400731:85 , srv1322652952:85 , srv1501554785:85 , srv233537579:85 , srv614812136:85 , srv1092064771:684 }
2023-04-14 12:55:43,695 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 430), ProcessCount=169 (was 169), AvailableMemoryMB=1455 (was 1936)
2023-04-14 12:55:43,703 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=169, AvailableMemoryMB=1454
2023-04-14 12:55:43,704 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-14 12:55:43,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-14 12:55:43,715 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1027759600:84 , srv1094586212:84 , srv1119548424:84 , srv1124741516:84 , srv1168428516:84 , srv1197867815:84 , srv1258320497:84 , srv1391865227:84 , srv1397272885:84 , srv1652651565:84 , srv1673789027:84 , srv1758338080:84 , srv1934127122:84 , srv1941620145:84 , srv2020136253:84 , srv2079238911:84 , srv264222787:84 , srv383624643:84 , srv385444797:84 , srv587391376:84 , srv634520503:84 , srv759476138:84 , srv811590618:84 , srv817244371:84 , srv88996700:84 , srv890370099:84 , srv961780739:84 , srv965767778:84 , srv991603117:84 , srv6676624:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-14 12:55:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:55:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1027759600=0, srv88996700=25, srv1168428516=4, srv385444797=18, srv1652651565=9, srv1119548424=2, srv965767778=28, srv2020136253=14, srv890370099=26, srv2079238911=15, srv264222787=16, srv759476138=22, srv1258320497=6, srv1673789027=10, srv811590618=23, srv1758338080=11, srv1397272885=8, srv1941620145=13, srv587391376=19, srv1124741516=3, srv991603117=29, srv383624643=17, srv817244371=24, srv634520503=20, srv1391865227=7, srv961780739=27, srv1094586212=1, srv6676624=21, srv1197867815=5, srv1934127122=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:55:43,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:55:43,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:55:43,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:55:43,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:55:43,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:55:43,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:55:43,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:55:43,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:55:43,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-14 12:55:43,760 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1532823360632505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:55:43,760 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912676030900086, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1532823360632505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-14 12:57:43,735 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6303050 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912676030900086 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:57:43,741 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1027759600:90 , srv1094586212:90 , srv1119548424:90 , srv1124741516:90 , srv1168428516:90 , srv1197867815:90 , srv1258320497:90 , srv1391865227:90 , srv1397272885:90 , srv1652651565:90 , srv1673789027:90 , srv1758338080:90 , srv1934127122:90 , srv1941620145:90 , srv2020136253:90 , srv2079238911:90 , srv264222787:90 , srv383624643:90 , srv385444797:90 , srv587391376:90 , srv634520503:90 , srv6676624:90 , srv759476138:90 , srv811590618:90 , srv817244371:90 , srv88996700:90 , srv890370099:90 , srv961780739:90 , srv965767778:90 , srv991603117:90 }
2023-04-14 12:57:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 12:57:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1027759600=0, srv88996700=25, srv1168428516=4, srv385444797=18, srv1652651565=9, srv1119548424=2, srv965767778=28, srv2020136253=14, srv890370099=26, srv2079238911=15, srv264222787=16, srv759476138=22, srv1258320497=6, srv1673789027=10, srv811590618=23, srv1758338080=11, srv1397272885=8, srv1941620145=13, srv587391376=19, srv1124741516=3, srv991603117=29, srv383624643=17, srv817244371=24, srv634520503=20, srv1391865227=7, srv961780739=27, srv1094586212=1, srv6676624=21, srv1197867815=5, srv1934127122=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 12:57:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 12:57:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-14 12:57:43,759 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 12:57:43,759 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1027759600:90 , srv1094586212:90 , srv1119548424:90 , srv1124741516:90 , srv1168428516:90 , srv1197867815:90 , srv1258320497:90 , srv1391865227:90 , srv1397272885:90 , srv1652651565:90 , srv1673789027:90 , srv1758338080:90 , srv1934127122:90 , srv1941620145:90 , srv2020136253:90 , srv2079238911:90 , srv264222787:90 , srv383624643:90 , srv385444797:90 , srv587391376:90 , srv634520503:90 , srv6676624:90 , srv759476138:90 , srv811590618:90 , srv817244371:90 , srv88996700:90 , srv890370099:90 , srv961780739:90 , srv965767778:90 , srv991603117:90 }
2023-04-14 12:57:43,771 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 430), ProcessCount=169 (was 169), AvailableMemoryMB=1393 (was 1454)