2023-10-09 17:53:37,047 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-09 17:53:37,338 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-09 17:53:37,453 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-09 17:53:37,512 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-09 17:53:37,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-09 17:53:37,531 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=170, AvailableMemoryMB=10646
2023-10-09 17:53:37,534 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-09 17:53:37,534 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-09 17:53:37,660 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003799234:84 , srv1021855066:84 , srv1025191516:84 , srv1034827544:84 , srv1047450420:84 , srv1060866235:84 , srv1110689444:84 , srv1153726070:84 , srv1164008611:84 , srv1171584634:84 , srv1181233504:84 , srv1182810587:84 , srv1200414136:84 , srv1223788877:84 , srv1230217983:84 , srv1248115313:84 , srv1269228028:84 , srv1286555100:84 , srv1288305723:84 , srv1295628080:84 , srv1314563772:84 , srv1319971299:84 , srv137212420:84 , srv1378759032:84 , srv1394518706:84 , srv1454909501:84 , srv1487597589:84 , srv1519615139:84 , srv1530010539:84 , srv154668989:84 , srv1595296975:84 , srv1664061709:84 , srv1665018720:84 , srv1686428654:84 , srv1687539890:84 , srv1722828957:84 , srv1725313962:84 , srv1735486120:84 , srv174051426:84 , srv1746818713:84 , srv1766293117:84 , srv1771553974:84 , srv1811236342:84 , srv1812523843:84 , srv1835247403:84 , srv1849569885:84 , srv1857288397:84 , srv1860076441:84 , srv18748908:84 , srv1885454363:84 , srv1890977879:84 , srv1902802375:84 , srv1910727673:84 , srv1978517344:84 , srv202687362:84 , srv2104276411:84 , srv2105171739:84 , srv217658505:84 , srv219681244:84 , srv236341518:84 , srv245456791:84 , srv246498706:84 , srv251376594:84 , srv258313688:84 , srv308092414:84 , srv322047693:84 , srv324372177:84 , srv329386393:84 , srv400454724:84 , srv406121273:84 , srv407831006:84 , srv425916474:84 , srv447926230:84 , srv453535309:84 , srv466932724:84 , srv469226069:84 , srv503384751:84 , srv547392921:84 , srv548508174:84 , srv570903875:84 , srv596440804:84 , srv628966801:84 , srv633852889:84 , srv658669223:84 , srv668765796:84 , srv701384494:84 , srv719553866:84 , srv737746619:84 , srv75265594:84 , srv787400797:84 , srv816683632:84 , srv823556919:84 , srv862611378:84 , srv916021883:84 , srv962985675:84 , srv964070194:84 , srv982689639:84 , srv991726210:84 , srv996748451:84 , srv881067307:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-09 17:53:37,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:37,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286555100=17, srv1025191516=2, srv329386393=67, srv596440804=80, srv1885454363=49, srv1771553974=41, srv1182810587=11, srv1835247403=44, srv962985675=95, srv1181233504=10, srv1394518706=24, srv1519615139=27, srv1766293117=40, srv236341518=59, srv1910727673=52, srv996748451=99, srv137212420=22, srv453535309=73, srv1686428654=33, srv1060866235=5, srv75265594=88, srv816683632=90, srv18748908=48, srv1003799234=0, srv1812523843=43, srv246498706=61, srv862611378=92, srv1164008611=8, srv668765796=84, srv425916474=71, srv308092414=64, srv1200414136=12, srv1849569885=45, srv407831006=70, srv701384494=85, srv1664061709=31, srv217658505=57, srv1153726070=7, srv628966801=81, srv1665018720=32, srv1735486120=37, srv322047693=65, srv1248115313=15, srv1319971299=21, srv245456791=60, srv1722828957=35, srv658669223=83, srv1034827544=3, srv251376594=62, srv881067307=93, srv1021855066=1, srv469226069=75, srv1902802375=51, srv547392921=77, srv202687362=54, srv2105171739=56, srv466932724=74, srv737746619=87, srv548508174=78, srv1487597589=26, srv406121273=69, srv787400797=89, srv324372177=66, srv447926230=72, srv823556919=91, srv1288305723=18, srv1223788877=13, srv400454724=68, srv1171584634=9, srv1295628080=19, srv1378759032=23, srv174051426=38, srv1860076441=47, srv964070194=96, srv154668989=29, srv1890977879=50, srv916021883=94, srv719553866=86, srv1978517344=53, srv1454909501=25, srv503384751=76, srv991726210=98, srv258313688=63, srv1687539890=34, srv2104276411=55, srv1857288397=46, srv1230217983=14, srv1269228028=16, srv570903875=79, srv1595296975=30, srv1047450420=4, srv982689639=97, srv219681244=58, srv1314563772=20, srv1530010539=28, srv1811236342=42, srv1110689444=6, srv1746818713=39, srv633852889=82, srv1725313962=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:37,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:37,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:37,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:37,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:37,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:37,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:37,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:37,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:37,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:37,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:37,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:37,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:37,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:37,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:37,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:37,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:37,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:37,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:37,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:37,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:37,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:37,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:37,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:37,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:37,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:37,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:37,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:37,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:37,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:37,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:37,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-09 17:53:37,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-09 17:53:37,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-09 17:53:37,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-09 17:53:37,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-09 17:53:37,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-09 17:53:37,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-09 17:53:37,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-09 17:53:37,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-09 17:53:37,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-09 17:53:37,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-09 17:53:37,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-09 17:53:37,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-09 17:53:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-09 17:53:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-09 17:53:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-09 17:53:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-09 17:53:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-09 17:53:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-09 17:53:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-09 17:53:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-09 17:53:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-09 17:53:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-09 17:53:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-09 17:53:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-09 17:53:37,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-09 17:53:37,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-09 17:53:37,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-09 17:53:37,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-09 17:53:37,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-09 17:53:37,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-09 17:53:37,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-09 17:53:37,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-09 17:53:37,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-09 17:53:37,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-09 17:53:37,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-09 17:53:37,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-09 17:53:37,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-09 17:53:37,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-09 17:53:37,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-09 17:53:37,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-09 17:53:38,090 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:38,090 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-09 17:53:38,091 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-09 17:53:38,476 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 680 ms to try 5000 different iterations.  Found a solution that moves 4697 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17787417016880278. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038712925616668656, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05506245815926642, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5218888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038712925616668656, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:38,490 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1248115313:83 , srv1378759032:83 , srv1766293117:83 , srv246498706:83 , srv425916474:83 , srv466932724:83 , srv548508174:83 , srv1021855066:84 , srv1025191516:84 , srv1047450420:84 , srv1110689444:84 , srv1182810587:84 , srv1269228028:84 , srv1295628080:84 , srv1722828957:84 , srv174051426:84 , srv1811236342:84 , srv1812523843:84 , srv217658505:84 , srv407831006:84 , srv547392921:84 , srv596440804:84 , srv737746619:84 , srv991726210:84 , srv1171584634:85 , srv1181233504:85 , srv1223788877:85 , srv1454909501:85 , srv1519615139:85 , srv154668989:85 , srv1686428654:85 , srv1890977879:85 , srv2105171739:85 , srv219681244:85 , srv245456791:85 , srv308092414:85 , srv322047693:85 , srv816683632:85 , srv964070194:85 , srv1314563772:86 , srv137212420:86 , srv1530010539:86 , srv1595296975:86 , srv1771553974:86 , srv1860076441:86 , srv18748908:86 , srv1978517344:86 , srv258313688:86 , srv329386393:86 , srv570903875:86 , srv628966801:86 , srv658669223:86 , srv668765796:86 , srv75265594:86 , srv823556919:86 , srv862611378:86 , srv962985675:86 , srv1060866235:87 , srv1164008611:87 , srv1200414136:87 , srv1288305723:87 , srv1319971299:87 , srv1394518706:87 , srv1735486120:87 , srv1746818713:87 , srv1835247403:87 , srv1885454363:87 , srv324372177:87 , srv503384751:87 , srv996748451:87 , srv1003799234:88 , srv1034827544:88 , srv1230217983:88 , srv1910727673:88 , srv2104276411:88 , srv406121273:88 , srv469226069:88 , srv719553866:88 , srv1487597589:89 , srv1664061709:89 , srv1665018720:89 , srv1902802375:89 , srv202687362:89 , srv447926230:89 , srv633852889:89 , srv1153726070:90 , srv1725313962:90 , srv236341518:90 , srv251376594:90 , srv400454724:90 , srv453535309:90 , srv701384494:90 , srv916021883:90 , srv982689639:90 , srv1687539890:91 , srv1849569885:91 , srv1286555100:94 , srv1857288397:94 , srv787400797:96 , srv881067307:434 }
2023-10-09 17:53:38,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:38,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286555100=17, srv1025191516=2, srv329386393=67, srv596440804=80, srv1885454363=49, srv1771553974=41, srv1182810587=11, srv1835247403=44, srv962985675=95, srv1181233504=10, srv1394518706=24, srv1519615139=27, srv1766293117=40, srv236341518=59, srv1910727673=52, srv996748451=99, srv137212420=22, srv453535309=73, srv1686428654=33, srv1060866235=5, srv75265594=88, srv816683632=90, srv18748908=48, srv1003799234=0, srv1812523843=43, srv246498706=61, srv862611378=92, srv1164008611=8, srv668765796=84, srv425916474=71, srv308092414=64, srv1200414136=12, srv1849569885=45, srv407831006=70, srv701384494=85, srv1664061709=31, srv217658505=57, srv1153726070=7, srv628966801=81, srv1665018720=32, srv1735486120=37, srv322047693=65, srv1248115313=15, srv1319971299=21, srv245456791=60, srv1722828957=35, srv658669223=83, srv1034827544=3, srv251376594=62, srv881067307=93, srv1021855066=1, srv469226069=75, srv1902802375=51, srv547392921=77, srv202687362=54, srv2105171739=56, srv466932724=74, srv737746619=87, srv548508174=78, srv1487597589=26, srv406121273=69, srv787400797=89, srv324372177=66, srv447926230=72, srv823556919=91, srv1288305723=18, srv1223788877=13, srv400454724=68, srv1171584634=9, srv1295628080=19, srv1378759032=23, srv174051426=38, srv1860076441=47, srv964070194=96, srv154668989=29, srv1890977879=50, srv916021883=94, srv719553866=86, srv1978517344=53, srv1454909501=25, srv503384751=76, srv991726210=98, srv258313688=63, srv1687539890=34, srv2104276411=55, srv1857288397=46, srv1230217983=14, srv1269228028=16, srv570903875=79, srv1595296975=30, srv1047450420=4, srv982689639=97, srv219681244=58, srv1314563772=20, srv1530010539=28, srv1811236342=42, srv1110689444=6, srv1746818713=39, srv633852889=82, srv1725313962=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:38,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:38,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:38,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:38,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:38,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:38,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:38,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:38,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-09 17:53:38,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-09 17:53:38,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-09 17:53:38,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-09 17:53:38,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-09 17:53:38,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-09 17:53:38,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-09 17:53:38,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-09 17:53:38,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-09 17:53:38,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-09 17:53:38,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-09 17:53:38,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038712925616668656, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05506245815926642, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038712925616668656, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:38,686 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-09 17:53:38,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17784128107185, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038712925616668656, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05506245815926642, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038712925616668656, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-09 17:53:39,054 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 509 ms to try 5000 different iterations.  Found a solution that moves 2647 regions; Going from a computed imbalance of 0.17784128107185 to a new imbalance of 0.015156630584231192. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023184550501742025); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03484775288354398, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2941111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023184550501742025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:39,077 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1286555100:75 , srv787400797:76 , srv1857288397:78 , srv236341518:80 , srv1034827544:81 , srv1902802375:82 , srv324372177:82 , srv447926230:82 , srv633852889:82 , srv982689639:82 , srv1153726070:83 , srv1664061709:83 , srv1665018720:83 , srv1725313962:83 , srv1746818713:83 , srv1849569885:83 , srv258313688:83 , srv406121273:83 , srv453535309:83 , srv469226069:83 , srv916021883:83 , srv1060866235:84 , srv1288305723:84 , srv1687539890:84 , srv1771553974:84 , srv202687362:84 , srv251376594:84 , srv329386393:84 , srv701384494:84 , srv1164008611:85 , srv1181233504:85 , srv1319971299:85 , srv137212420:85 , srv1487597589:85 , srv1519615139:85 , srv1530010539:85 , srv154668989:85 , srv1595296975:85 , srv1835247403:85 , srv1860076441:85 , srv18748908:85 , srv1910727673:85 , srv1978517344:85 , srv2105171739:85 , srv400454724:85 , srv658669223:85 , srv719553866:85 , srv962985675:85 , srv996748451:85 , srv1003799234:86 , srv1171584634:86 , srv1200414136:86 , srv1230217983:86 , srv1269228028:86 , srv1295628080:86 , srv1378759032:86 , srv1394518706:86 , srv1722828957:86 , srv1735486120:86 , srv1811236342:86 , srv1812523843:86 , srv1885454363:86 , srv1890977879:86 , srv2104276411:86 , srv217658505:86 , srv219681244:86 , srv308092414:86 , srv322047693:86 , srv503384751:86 , srv628966801:86 , srv823556919:86 , srv1047450420:87 , srv1223788877:87 , srv1314563772:87 , srv1686428654:87 , srv466932724:87 , srv547392921:87 , srv570903875:87 , srv668765796:87 , srv737746619:87 , srv75265594:87 , srv862611378:87 , srv1454909501:88 , srv245456791:88 , srv425916474:88 , srv1025191516:89 , srv1110689444:89 , srv1182810587:89 , srv174051426:89 , srv407831006:89 , srv816683632:89 , srv991726210:89 , srv1248115313:90 , srv1766293117:90 , srv246498706:90 , srv596440804:90 , srv1021855066:91 , srv548508174:91 , srv964070194:91 , srv881067307:546 }
2023-10-09 17:53:39,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:39,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286555100=17, srv1025191516=2, srv329386393=67, srv596440804=80, srv1885454363=49, srv1771553974=41, srv1182810587=11, srv1835247403=44, srv962985675=95, srv1181233504=10, srv1394518706=24, srv1519615139=27, srv1766293117=40, srv236341518=59, srv1910727673=52, srv996748451=99, srv137212420=22, srv453535309=73, srv1686428654=33, srv1060866235=5, srv75265594=88, srv816683632=90, srv18748908=48, srv1003799234=0, srv1812523843=43, srv246498706=61, srv862611378=92, srv1164008611=8, srv668765796=84, srv425916474=71, srv308092414=64, srv1200414136=12, srv1849569885=45, srv407831006=70, srv701384494=85, srv1664061709=31, srv217658505=57, srv1153726070=7, srv628966801=81, srv1665018720=32, srv1735486120=37, srv322047693=65, srv1248115313=15, srv1319971299=21, srv245456791=60, srv1722828957=35, srv658669223=83, srv1034827544=3, srv251376594=62, srv881067307=93, srv1021855066=1, srv469226069=75, srv1902802375=51, srv547392921=77, srv202687362=54, srv2105171739=56, srv466932724=74, srv737746619=87, srv548508174=78, srv1487597589=26, srv406121273=69, srv787400797=89, srv324372177=66, srv447926230=72, srv823556919=91, srv1288305723=18, srv1223788877=13, srv400454724=68, srv1171584634=9, srv1295628080=19, srv1378759032=23, srv174051426=38, srv1860076441=47, srv964070194=96, srv154668989=29, srv1890977879=50, srv916021883=94, srv719553866=86, srv1978517344=53, srv1454909501=25, srv503384751=76, srv991726210=98, srv258313688=63, srv1687539890=34, srv2104276411=55, srv1857288397=46, srv1230217983=14, srv1269228028=16, srv570903875=79, srv1595296975=30, srv1047450420=4, srv982689639=97, srv219681244=58, srv1314563772=20, srv1530010539=28, srv1811236342=42, srv1110689444=6, srv1746818713=39, srv633852889=82, srv1725313962=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:39,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:39,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:39,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-09 17:53:39,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-09 17:53:39,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-09 17:53:39,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-09 17:53:39,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-09 17:53:39,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-09 17:53:39,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-09 17:53:39,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-09 17:53:39,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-09 17:53:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-09 17:53:39,300 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023184550501742025); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03484775288354398, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023184550501742025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:39,300 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-09 17:53:39,300 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015138095894081317, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023184550501742025); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03484775288354398, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023184550501742025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-09 17:53:39,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 432 ms to try 5000 different iterations.  Found a solution that moves 958 regions; Going from a computed imbalance of 0.015138095894081317 to a new imbalance of 0.001227802021044072. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006428596171346909); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009392310057461275); MoveCostFunction : (multiplier=7.0, imbalance=0.10644444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006428596171346909); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:39,588 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv964070194:81 , srv1021855066:82 , srv400454724:82 , srv1230217983:83 , srv1487597589:83 , srv1687539890:83 , srv1849569885:83 , srv251376594:83 , srv453535309:83 , srv548508174:83 , srv701384494:83 , srv816683632:83 , srv1003799234:84 , srv1153726070:84 , srv1182810587:84 , srv1200414136:84 , srv1394518706:84 , srv1454909501:84 , srv1725313962:84 , srv1735486120:84 , srv174051426:84 , srv1766293117:84 , srv1885454363:84 , srv202687362:84 , srv2104276411:84 , srv245456791:84 , srv407831006:84 , srv503384751:84 , srv596440804:84 , srv719553866:84 , srv1025191516:85 , srv1110689444:85 , srv1164008611:85 , srv1223788877:85 , srv1314563772:85 , srv1319971299:85 , srv1664061709:85 , srv1665018720:85 , srv1835247403:85 , srv1857288397:85 , srv1910727673:85 , srv246498706:85 , srv570903875:85 , srv628966801:85 , srv668765796:85 , srv75265594:85 , srv862611378:85 , srv916021883:85 , srv991726210:85 , srv1171584634:86 , srv1248115313:86 , srv1288305723:86 , srv137212420:86 , srv1595296975:86 , srv1686428654:86 , srv1890977879:86 , srv1902802375:86 , srv1978517344:86 , srv406121273:86 , srv447926230:86 , srv633852889:86 , srv658669223:86 , srv787400797:86 , srv823556919:86 , srv982689639:86 , srv996748451:86 , srv1047450420:87 , srv1060866235:87 , srv1269228028:87 , srv1295628080:87 , srv1519615139:87 , srv1530010539:87 , srv154668989:87 , srv1746818713:87 , srv1771553974:87 , srv1811236342:87 , srv1812523843:87 , srv18748908:87 , srv2105171739:87 , srv217658505:87 , srv219681244:87 , srv308092414:87 , srv322047693:87 , srv329386393:87 , srv425916474:87 , srv469226069:87 , srv547392921:87 , srv737746619:87 , srv962985675:87 , srv1034827544:88 , srv1181233504:88 , srv1286555100:88 , srv1378759032:88 , srv1722828957:88 , srv1860076441:88 , srv466932724:88 , srv236341518:89 , srv258313688:89 , srv324372177:89 , srv881067307:535 }
2023-10-09 17:53:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286555100=17, srv1025191516=2, srv329386393=67, srv596440804=80, srv1885454363=49, srv1771553974=41, srv1182810587=11, srv1835247403=44, srv962985675=95, srv1181233504=10, srv1394518706=24, srv1519615139=27, srv1766293117=40, srv236341518=59, srv1910727673=52, srv996748451=99, srv137212420=22, srv453535309=73, srv1686428654=33, srv1060866235=5, srv75265594=88, srv816683632=90, srv18748908=48, srv1003799234=0, srv1812523843=43, srv246498706=61, srv862611378=92, srv1164008611=8, srv668765796=84, srv425916474=71, srv308092414=64, srv1200414136=12, srv1849569885=45, srv407831006=70, srv701384494=85, srv1664061709=31, srv217658505=57, srv1153726070=7, srv628966801=81, srv1665018720=32, srv1735486120=37, srv322047693=65, srv1248115313=15, srv1319971299=21, srv245456791=60, srv1722828957=35, srv658669223=83, srv1034827544=3, srv251376594=62, srv881067307=93, srv1021855066=1, srv469226069=75, srv1902802375=51, srv547392921=77, srv202687362=54, srv2105171739=56, srv466932724=74, srv737746619=87, srv548508174=78, srv1487597589=26, srv406121273=69, srv787400797=89, srv324372177=66, srv447926230=72, srv823556919=91, srv1288305723=18, srv1223788877=13, srv400454724=68, srv1171584634=9, srv1295628080=19, srv1378759032=23, srv174051426=38, srv1860076441=47, srv964070194=96, srv154668989=29, srv1890977879=50, srv916021883=94, srv719553866=86, srv1978517344=53, srv1454909501=25, srv503384751=76, srv991726210=98, srv258313688=63, srv1687539890=34, srv2104276411=55, srv1857288397=46, srv1230217983=14, srv1269228028=16, srv570903875=79, srv1595296975=30, srv1047450420=4, srv982689639=97, srv219681244=58, srv1314563772=20, srv1530010539=28, srv1811236342=42, srv1110689444=6, srv1746818713=39, srv633852889=82, srv1725313962=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-09 17:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-09 17:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-09 17:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-09 17:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-09 17:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-09 17:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-09 17:53:39,729 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006428596171346909); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009392310057461275); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006428596171346909); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:39,729 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-09 17:53:39,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.001221093961669844, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006428596171346909); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009392310057461275); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006428596171346909); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-09 17:53:40,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 528 ms to try 5000 different iterations.  Found a solution that moves 261 regions; Going from a computed imbalance of 0.001221093961669844 to a new imbalance of 5.1040519388417E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.029, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:40,148 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1181233504:83 , srv1860076441:83 , srv236341518:83 , srv1003799234:84 , srv1025191516:84 , srv1047450420:84 , srv1060866235:84 , srv1110689444:84 , srv1248115313:84 , srv1288305723:84 , srv1314563772:84 , srv1530010539:84 , srv154668989:84 , srv1686428654:84 , srv1687539890:84 , srv1735486120:84 , srv1849569885:84 , srv18748908:84 , srv1885454363:84 , srv2104276411:84 , srv217658505:84 , srv219681244:84 , srv246498706:84 , srv322047693:84 , srv324372177:84 , srv407831006:84 , srv469226069:84 , srv547392921:84 , srv570903875:84 , srv596440804:84 , srv628966801:84 , srv668765796:84 , srv701384494:84 , srv737746619:84 , srv75265594:84 , srv787400797:84 , srv823556919:84 , srv862611378:84 , srv916021883:84 , srv962985675:84 , srv982689639:84 , srv996748451:84 , srv1021855066:85 , srv1034827544:85 , srv1153726070:85 , srv1164008611:85 , srv1171584634:85 , srv1182810587:85 , srv1200414136:85 , srv1223788877:85 , srv1230217983:85 , srv1269228028:85 , srv1286555100:85 , srv1295628080:85 , srv1319971299:85 , srv137212420:85 , srv1378759032:85 , srv1394518706:85 , srv1454909501:85 , srv1487597589:85 , srv1519615139:85 , srv1595296975:85 , srv1664061709:85 , srv1665018720:85 , srv1722828957:85 , srv174051426:85 , srv1746818713:85 , srv1766293117:85 , srv1771553974:85 , srv1811236342:85 , srv1812523843:85 , srv1835247403:85 , srv1857288397:85 , srv1890977879:85 , srv1902802375:85 , srv1910727673:85 , srv1978517344:85 , srv202687362:85 , srv2105171739:85 , srv245456791:85 , srv251376594:85 , srv258313688:85 , srv308092414:85 , srv329386393:85 , srv400454724:85 , srv406121273:85 , srv425916474:85 , srv447926230:85 , srv466932724:85 , srv548508174:85 , srv633852889:85 , srv658669223:85 , srv719553866:85 , srv816683632:85 , srv964070194:85 , srv991726210:85 , srv1725313962:86 , srv453535309:86 , srv503384751:86 , srv881067307:627 }
2023-10-09 17:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286555100=17, srv1025191516=2, srv329386393=67, srv596440804=80, srv1885454363=49, srv1771553974=41, srv1182810587=11, srv1835247403=44, srv962985675=95, srv1181233504=10, srv1394518706=24, srv1519615139=27, srv1766293117=40, srv236341518=59, srv1910727673=52, srv996748451=99, srv137212420=22, srv453535309=73, srv1686428654=33, srv1060866235=5, srv75265594=88, srv816683632=90, srv18748908=48, srv1003799234=0, srv1812523843=43, srv246498706=61, srv862611378=92, srv1164008611=8, srv668765796=84, srv425916474=71, srv308092414=64, srv1200414136=12, srv1849569885=45, srv407831006=70, srv701384494=85, srv1664061709=31, srv217658505=57, srv1153726070=7, srv628966801=81, srv1665018720=32, srv1735486120=37, srv322047693=65, srv1248115313=15, srv1319971299=21, srv245456791=60, srv1722828957=35, srv658669223=83, srv1034827544=3, srv251376594=62, srv881067307=93, srv1021855066=1, srv469226069=75, srv1902802375=51, srv547392921=77, srv202687362=54, srv2105171739=56, srv466932724=74, srv737746619=87, srv548508174=78, srv1487597589=26, srv406121273=69, srv787400797=89, srv324372177=66, srv447926230=72, srv823556919=91, srv1288305723=18, srv1223788877=13, srv400454724=68, srv1171584634=9, srv1295628080=19, srv1378759032=23, srv174051426=38, srv1860076441=47, srv964070194=96, srv154668989=29, srv1890977879=50, srv916021883=94, srv719553866=86, srv1978517344=53, srv1454909501=25, srv503384751=76, srv991726210=98, srv258313688=63, srv1687539890=34, srv2104276411=55, srv1857288397=46, srv1230217983=14, srv1269228028=16, srv570903875=79, srv1595296975=30, srv1047450420=4, srv982689639=97, srv219681244=58, srv1314563772=20, srv1530010539=28, srv1811236342=42, srv1110689444=6, srv1746818713=39, srv633852889=82, srv1725313962=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:40,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:40,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:40,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:40,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:40,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:40,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:40,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-09 17:53:40,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-09 17:53:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-09 17:53:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-09 17:53:40,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-09 17:53:40,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-09 17:53:40,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-09 17:53:40,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-09 17:53:40,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-09 17:53:40,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-09 17:53:40,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-09 17:53:40,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-09 17:53:40,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-09 17:53:40,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:40,337 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-09 17:53:40,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.9212958327171195E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-09 17:53:40,667 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 473 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 4.9212958327171195E-5 to a new imbalance of 7.332318833747435E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:40,667 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1248115313:83 , srv1722828957:83 , srv1725313962:83 , srv1910727673:83 , srv258313688:83 , srv308092414:83 , srv425916474:83 , srv466932724:83 , srv503384751:83 , srv991726210:83 , srv1003799234:84 , srv1021855066:84 , srv1025191516:84 , srv1034827544:84 , srv1047450420:84 , srv1060866235:84 , srv1110689444:84 , srv1153726070:84 , srv1164008611:84 , srv1171584634:84 , srv1182810587:84 , srv1200414136:84 , srv1223788877:84 , srv1230217983:84 , srv1269228028:84 , srv1286555100:84 , srv1295628080:84 , srv1314563772:84 , srv1319971299:84 , srv137212420:84 , srv1378759032:84 , srv1394518706:84 , srv1454909501:84 , srv1487597589:84 , srv1519615139:84 , srv1530010539:84 , srv1595296975:84 , srv1664061709:84 , srv1665018720:84 , srv1686428654:84 , srv1687539890:84 , srv174051426:84 , srv1746818713:84 , srv1766293117:84 , srv1771553974:84 , srv1811236342:84 , srv1812523843:84 , srv1835247403:84 , srv1857288397:84 , srv1860076441:84 , srv18748908:84 , srv1890977879:84 , srv1902802375:84 , srv1978517344:84 , srv202687362:84 , srv2104276411:84 , srv2105171739:84 , srv219681244:84 , srv236341518:84 , srv245456791:84 , srv246498706:84 , srv251376594:84 , srv322047693:84 , srv324372177:84 , srv329386393:84 , srv400454724:84 , srv406121273:84 , srv447926230:84 , srv453535309:84 , srv469226069:84 , srv547392921:84 , srv548508174:84 , srv570903875:84 , srv596440804:84 , srv633852889:84 , srv658669223:84 , srv668765796:84 , srv719553866:84 , srv737746619:84 , srv75265594:84 , srv787400797:84 , srv816683632:84 , srv823556919:84 , srv862611378:84 , srv916021883:84 , srv962985675:84 , srv964070194:84 , srv982689639:84 , srv996748451:84 , srv1181233504:85 , srv1288305723:85 , srv154668989:85 , srv1735486120:85 , srv1849569885:85 , srv1885454363:85 , srv217658505:85 , srv407831006:85 , srv628966801:85 , srv701384494:85 , srv881067307:684 }
2023-10-09 17:53:40,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:40,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286555100=17, srv1025191516=2, srv329386393=67, srv596440804=80, srv1885454363=49, srv1771553974=41, srv1182810587=11, srv1835247403=44, srv962985675=95, srv1181233504=10, srv1394518706=24, srv1519615139=27, srv1766293117=40, srv236341518=59, srv1910727673=52, srv996748451=99, srv137212420=22, srv453535309=73, srv1686428654=33, srv1060866235=5, srv75265594=88, srv816683632=90, srv18748908=48, srv1003799234=0, srv1812523843=43, srv246498706=61, srv862611378=92, srv1164008611=8, srv668765796=84, srv425916474=71, srv308092414=64, srv1200414136=12, srv1849569885=45, srv407831006=70, srv701384494=85, srv1664061709=31, srv217658505=57, srv1153726070=7, srv628966801=81, srv1665018720=32, srv1735486120=37, srv322047693=65, srv1248115313=15, srv1319971299=21, srv245456791=60, srv1722828957=35, srv658669223=83, srv1034827544=3, srv251376594=62, srv881067307=93, srv1021855066=1, srv469226069=75, srv1902802375=51, srv547392921=77, srv202687362=54, srv2105171739=56, srv466932724=74, srv737746619=87, srv548508174=78, srv1487597589=26, srv406121273=69, srv787400797=89, srv324372177=66, srv447926230=72, srv823556919=91, srv1288305723=18, srv1223788877=13, srv400454724=68, srv1171584634=9, srv1295628080=19, srv1378759032=23, srv174051426=38, srv1860076441=47, srv964070194=96, srv154668989=29, srv1890977879=50, srv916021883=94, srv719553866=86, srv1978517344=53, srv1454909501=25, srv503384751=76, srv991726210=98, srv258313688=63, srv1687539890=34, srv2104276411=55, srv1857288397=46, srv1230217983=14, srv1269228028=16, srv570903875=79, srv1595296975=30, srv1047450420=4, srv982689639=97, srv219681244=58, srv1314563772=20, srv1530010539=28, srv1811236342=42, srv1110689444=6, srv1746818713=39, srv633852889=82, srv1725313962=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:40,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-09 17:53:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-09 17:53:40,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-09 17:53:40,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-09 17:53:40,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-09 17:53:40,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-09 17:53:40,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-09 17:53:40,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-09 17:53:40,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-09 17:53:40,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-09 17:53:40,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-09 17:53:40,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-09 17:53:40,824 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:40,825 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1248115313:83 , srv1722828957:83 , srv1725313962:83 , srv1910727673:83 , srv258313688:83 , srv308092414:83 , srv425916474:83 , srv466932724:83 , srv503384751:83 , srv991726210:83 , srv1003799234:84 , srv1021855066:84 , srv1025191516:84 , srv1034827544:84 , srv1047450420:84 , srv1060866235:84 , srv1110689444:84 , srv1153726070:84 , srv1164008611:84 , srv1171584634:84 , srv1182810587:84 , srv1200414136:84 , srv1223788877:84 , srv1230217983:84 , srv1269228028:84 , srv1286555100:84 , srv1295628080:84 , srv1314563772:84 , srv1319971299:84 , srv137212420:84 , srv1378759032:84 , srv1394518706:84 , srv1454909501:84 , srv1487597589:84 , srv1519615139:84 , srv1530010539:84 , srv1595296975:84 , srv1664061709:84 , srv1665018720:84 , srv1686428654:84 , srv1687539890:84 , srv174051426:84 , srv1746818713:84 , srv1766293117:84 , srv1771553974:84 , srv1811236342:84 , srv1812523843:84 , srv1835247403:84 , srv1857288397:84 , srv1860076441:84 , srv18748908:84 , srv1890977879:84 , srv1902802375:84 , srv1978517344:84 , srv202687362:84 , srv2104276411:84 , srv2105171739:84 , srv219681244:84 , srv236341518:84 , srv245456791:84 , srv246498706:84 , srv251376594:84 , srv322047693:84 , srv324372177:84 , srv329386393:84 , srv400454724:84 , srv406121273:84 , srv447926230:84 , srv453535309:84 , srv469226069:84 , srv547392921:84 , srv548508174:84 , srv570903875:84 , srv596440804:84 , srv633852889:84 , srv658669223:84 , srv668765796:84 , srv719553866:84 , srv737746619:84 , srv75265594:84 , srv787400797:84 , srv816683632:84 , srv823556919:84 , srv862611378:84 , srv916021883:84 , srv962985675:84 , srv964070194:84 , srv982689639:84 , srv996748451:84 , srv1181233504:85 , srv1288305723:85 , srv154668989:85 , srv1735486120:85 , srv1849569885:85 , srv1885454363:85 , srv217658505:85 , srv407831006:85 , srv628966801:85 , srv701384494:85 , srv881067307:684 }
2023-10-09 17:53:40,860 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=170 (was 170), AvailableMemoryMB=10650 (was 10646) - AvailableMemoryMB LEAK? -
2023-10-09 17:53:40,877 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=171, AvailableMemoryMB=10648
2023-10-09 17:53:40,879 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-09 17:53:40,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-09 17:53:40,901 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1035989954:84 , srv1075113938:84 , srv1138560120:84 , srv1211306581:84 , srv1294743668:84 , srv1427258879:84 , srv1514003192:84 , srv1556461281:84 , srv1647023561:84 , srv1748549785:84 , srv1807284593:84 , srv185293072:84 , srv1918281707:84 , srv2001273582:84 , srv2022436556:84 , srv2060132732:84 , srv2133936351:84 , srv22264744:84 , srv225833579:84 , srv277874941:84 , srv351741161:84 , srv540370182:84 , srv560806622:84 , srv659534615:84 , srv834736932:84 , srv844455422:84 , srv865027055:84 , srv956331130:84 , srv965109197:84 , srv1506645403:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-09 17:53:40,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:53:40,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185293072=12, srv2060132732=16, srv1556461281=8, srv540370182=22, srv1807284593=11, srv834736932=25, srv1918281707=13, srv2001273582=14, srv1138560120=2, srv277874941=20, srv659534615=24, srv1427258879=5, srv1075113938=1, srv1035989954=0, srv225833579=19, srv1514003192=7, srv1647023561=9, srv22264744=18, srv351741161=21, srv2133936351=17, srv1294743668=4, srv2022436556=15, srv560806622=23, srv1211306581=3, srv965109197=29, srv956331130=28, srv865027055=27, srv844455422=26, srv1748549785=10, srv1506645403=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:53:40,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:53:40,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:53:40,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:53:40,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:53:40,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-09 17:53:40,951 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0915021258582913, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:53:40,951 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912481363475041, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0915021258582913, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-09 17:55:40,930 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5451341 different iterations.  Found a solution that moves 1864 regions; Going from a computed imbalance of 0.9912481363475041 to a new imbalance of 4.3506689887128686E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6903703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:55:40,936 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1035989954:90 , srv1075113938:90 , srv1138560120:90 , srv1211306581:90 , srv1294743668:90 , srv1427258879:90 , srv1506645403:90 , srv1514003192:90 , srv1556461281:90 , srv1647023561:90 , srv1748549785:90 , srv1807284593:90 , srv185293072:90 , srv1918281707:90 , srv2001273582:90 , srv2022436556:90 , srv2060132732:90 , srv2133936351:90 , srv22264744:90 , srv225833579:90 , srv277874941:90 , srv351741161:90 , srv540370182:90 , srv560806622:90 , srv659534615:90 , srv834736932:90 , srv844455422:90 , srv865027055:90 , srv956331130:90 , srv965109197:90 }
2023-10-09 17:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-09 17:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv185293072=12, srv2060132732=16, srv1556461281=8, srv540370182=22, srv1807284593=11, srv834736932=25, srv1918281707=13, srv2001273582=14, srv1138560120=2, srv277874941=20, srv659534615=24, srv1427258879=5, srv1075113938=1, srv1035989954=0, srv225833579=19, srv1514003192=7, srv1647023561=9, srv22264744=18, srv351741161=21, srv2133936351=17, srv1294743668=4, srv2022436556=15, srv560806622=23, srv1211306581=3, srv965109197=29, srv956331130=28, srv865027055=27, srv844455422=26, srv1748549785=10, srv1506645403=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-09 17:55:40,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-09 17:55:40,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-09 17:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-09 17:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-09 17:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-09 17:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-09 17:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-09 17:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-09 17:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-09 17:55:40,953 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-09 17:55:40,954 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1035989954:90 , srv1075113938:90 , srv1138560120:90 , srv1211306581:90 , srv1294743668:90 , srv1427258879:90 , srv1506645403:90 , srv1514003192:90 , srv1556461281:90 , srv1647023561:90 , srv1748549785:90 , srv1807284593:90 , srv185293072:90 , srv1918281707:90 , srv2001273582:90 , srv2022436556:90 , srv2060132732:90 , srv2133936351:90 , srv22264744:90 , srv225833579:90 , srv277874941:90 , srv351741161:90 , srv540370182:90 , srv560806622:90 , srv659534615:90 , srv834736932:90 , srv844455422:90 , srv865027055:90 , srv956331130:90 , srv965109197:90 }
2023-10-09 17:55:40,966 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 301), ProcessCount=170 (was 171), AvailableMemoryMB=9757 (was 10648)