2023-07-22 09:53:12,563 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-22 09:53:12,954 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-22 09:53:13,066 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-22 09:53:13,135 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-22 09:53:13,144 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-22 09:53:13,159 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=173, AvailableMemoryMB=11105
2023-07-22 09:53:13,161 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-22 09:53:13,162 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-22 09:53:13,315 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010144606:84 , srv1013933676:84 , srv1026279003:84 , srv1074126638:84 , srv1093024449:84 , srv1109872339:84 , srv1131927689:84 , srv1148017461:84 , srv1149011964:84 , srv1178700766:84 , srv1192076238:84 , srv1202738641:84 , srv1243533079:84 , srv1267916056:84 , srv1273765581:84 , srv1350162180:84 , srv1354619694:84 , srv1377475830:84 , srv1377981688:84 , srv1470845595:84 , srv1477917355:84 , srv1510686851:84 , srv151367718:84 , srv1554935288:84 , srv1600460979:84 , srv1626430391:84 , srv1688899597:84 , srv1695399482:84 , srv1698492794:84 , srv1699289576:84 , srv1725085256:84 , srv1732852512:84 , srv1760075747:84 , srv1777295923:84 , srv1792444410:84 , srv1809298143:84 , srv1814960362:84 , srv1815241482:84 , srv1843330901:84 , srv1865446177:84 , srv1875139432:84 , srv1897466589:84 , srv1902139185:84 , srv19062361:84 , srv1918841006:84 , srv1921120282:84 , srv1946296907:84 , srv1951207451:84 , srv198449835:84 , srv1987143550:84 , srv2031710563:84 , srv2040546722:84 , srv2051449315:84 , srv205519980:84 , srv2061690445:84 , srv2090468514:84 , srv2112258722:84 , srv225934187:84 , srv234104582:84 , srv235962616:84 , srv242983792:84 , srv275422162:84 , srv290826721:84 , srv339754830:84 , srv349675897:84 , srv36176737:84 , srv365337041:84 , srv367536508:84 , srv369588989:84 , srv386133043:84 , srv386402361:84 , srv392038283:84 , srv396149180:84 , srv444503714:84 , srv487226193:84 , srv500082423:84 , srv51899639:84 , srv524734079:84 , srv554556638:84 , srv574320760:84 , srv581255468:84 , srv603742025:84 , srv605380299:84 , srv646155790:84 , srv651451882:84 , srv655791887:84 , srv703978289:84 , srv705082923:84 , srv7757095:84 , srv778745553:84 , srv787147431:84 , srv787683233:84 , srv795422431:84 , srv842414962:84 , srv84995593:84 , srv857237868:84 , srv866900959:84 , srv94393311:84 , srv980119433:84 , srv790107205:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-22 09:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1918841006=44, srv369588989=68, srv2090468514=55, srv787147431=90, srv36176737=65, srv1178700766=9, srv500082423=75, srv2040546722=51, srv1732852512=31, srv1760075747=32, srv1554935288=23, srv778745553=89, srv1951207451=47, srv705082923=87, srv2112258722=56, srv7757095=88, srv1792444410=34, srv365337041=66, srv444503714=73, srv386133043=69, srv51899639=76, srv524734079=77, srv1109872339=5, srv1698492794=28, srv1843330901=38, srv242983792=60, srv290826721=62, srv234104582=58, srv651451882=84, srv349675897=64, srv396149180=72, srv1814960362=36, srv275422162=61, srv1470845595=19, srv655791887=85, srv795422431=93, srv84995593=95, srv1815241482=37, srv1921120282=45, srv1350162180=15, srv1688899597=26, srv392038283=71, srv1875139432=40, srv1777295923=33, srv866900959=97, srv980119433=99, srv790107205=92, srv1202738641=11, srv1699289576=29, srv1131927689=6, srv487226193=74, srv1865446177=39, srv1902139185=42, srv1600460979=24, srv1725085256=30, srv1354619694=16, srv603742025=81, srv1267916056=13, srv94393311=98, srv787683233=91, srv857237868=96, srv646155790=83, srv1897466589=41, srv842414962=94, srv19062361=43, srv2031710563=50, srv367536508=67, srv235962616=59, srv574320760=79, srv386402361=70, srv1377475830=17, srv1946296907=46, srv2051449315=52, srv1149011964=8, srv151367718=22, srv1695399482=27, srv554556638=78, srv1987143550=49, srv2061690445=54, srv1809298143=35, srv703978289=86, srv1273765581=14, srv1074126638=3, srv225934187=57, srv339754830=63, srv1377981688=18, srv581255468=80, srv205519980=53, srv1148017461=7, srv1510686851=21, srv605380299=82, srv1093024449=4, srv1477917355=20, srv198449835=48, srv1013933676=1, srv1243533079=12, srv1192076238=10, srv1626430391=25, srv1010144606=0, srv1026279003=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-22 09:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-22 09:53:13,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-22 09:53:13,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-22 09:53:13,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-22 09:53:13,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-22 09:53:13,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-22 09:53:13,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-22 09:53:13,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-22 09:53:13,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-22 09:53:13,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-22 09:53:13,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-22 09:53:13,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-22 09:53:13,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-22 09:53:13,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-22 09:53:13,645 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:13,645 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-22 09:53:13,646 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-22 09:53:14,057 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 610 ms to try 5000 different iterations.  Found a solution that moves 4677 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17948213505918822. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04124360607143587, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05793490677579528, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5196666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04124360607143587, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17458333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24233333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:14,103 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv205519980:79 , srv1026279003:80 , srv1074126638:80 , srv386402361:80 , srv554556638:80 , srv1699289576:81 , srv603742025:81 , srv787147431:81 , srv151367718:82 , srv2061690445:82 , srv605380299:82 , srv1865446177:83 , srv1921120282:83 , srv198449835:83 , srv392038283:83 , srv94393311:83 , srv1093024449:84 , srv1109872339:84 , srv1192076238:84 , srv1202738641:84 , srv1267916056:84 , srv1554935288:84 , srv1809298143:84 , srv1815241482:84 , srv1902139185:84 , srv1951207451:84 , srv2031710563:84 , srv386133043:84 , srv574320760:84 , srv703978289:84 , srv787683233:84 , srv1470845595:85 , srv1600460979:85 , srv1777295923:85 , srv1843330901:85 , srv2090468514:85 , srv396149180:85 , srv487226193:85 , srv581255468:85 , srv866900959:85 , srv1377475830:86 , srv1377981688:86 , srv1477917355:86 , srv2040546722:86 , srv2051449315:86 , srv234104582:86 , srv242983792:86 , srv290826721:86 , srv339754830:86 , srv36176737:86 , srv524734079:86 , srv778745553:86 , srv842414962:86 , srv1178700766:87 , srv1350162180:87 , srv1626430391:87 , srv1732852512:87 , srv1897466589:87 , srv1918841006:87 , srv1946296907:87 , srv275422162:87 , srv365337041:87 , srv369588989:87 , srv655791887:87 , srv795422431:87 , srv1148017461:88 , srv1243533079:88 , srv1354619694:88 , srv1510686851:88 , srv1695399482:88 , srv1725085256:88 , srv1760075747:88 , srv1814960362:88 , srv19062361:88 , srv1987143550:88 , srv225934187:88 , srv367536508:88 , srv51899639:88 , srv705082923:88 , srv84995593:88 , srv1013933676:89 , srv1131927689:89 , srv1273765581:89 , srv444503714:89 , srv646155790:89 , srv1149011964:90 , srv1688899597:90 , srv980119433:90 , srv1875139432:91 , srv235962616:91 , srv7757095:91 , srv1010144606:92 , srv1792444410:92 , srv349675897:92 , srv500082423:92 , srv2112258722:93 , srv1698492794:95 , srv651451882:95 , srv857237868:95 , srv790107205:456 }
2023-07-22 09:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1918841006=44, srv369588989=68, srv2090468514=55, srv787147431=90, srv36176737=65, srv1178700766=9, srv500082423=75, srv2040546722=51, srv1732852512=31, srv1760075747=32, srv1554935288=23, srv778745553=89, srv1951207451=47, srv705082923=87, srv2112258722=56, srv7757095=88, srv1792444410=34, srv365337041=66, srv444503714=73, srv386133043=69, srv51899639=76, srv524734079=77, srv1109872339=5, srv1698492794=28, srv1843330901=38, srv242983792=60, srv290826721=62, srv234104582=58, srv651451882=84, srv349675897=64, srv396149180=72, srv1814960362=36, srv275422162=61, srv1470845595=19, srv655791887=85, srv795422431=93, srv84995593=95, srv1815241482=37, srv1921120282=45, srv1350162180=15, srv1688899597=26, srv392038283=71, srv1875139432=40, srv1777295923=33, srv866900959=97, srv980119433=99, srv790107205=92, srv1202738641=11, srv1699289576=29, srv1131927689=6, srv487226193=74, srv1865446177=39, srv1902139185=42, srv1600460979=24, srv1725085256=30, srv1354619694=16, srv603742025=81, srv1267916056=13, srv94393311=98, srv787683233=91, srv857237868=96, srv646155790=83, srv1897466589=41, srv842414962=94, srv19062361=43, srv2031710563=50, srv367536508=67, srv235962616=59, srv574320760=79, srv386402361=70, srv1377475830=17, srv1946296907=46, srv2051449315=52, srv1149011964=8, srv151367718=22, srv1695399482=27, srv554556638=78, srv1987143550=49, srv2061690445=54, srv1809298143=35, srv703978289=86, srv1273765581=14, srv1074126638=3, srv225934187=57, srv339754830=63, srv1377981688=18, srv581255468=80, srv205519980=53, srv1148017461=7, srv1510686851=21, srv605380299=82, srv1093024449=4, srv1477917355=20, srv198449835=48, srv1013933676=1, srv1243533079=12, srv1192076238=10, srv1626430391=25, srv1010144606=0, srv1026279003=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-22 09:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-22 09:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-22 09:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-22 09:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-22 09:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-22 09:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-22 09:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-22 09:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-22 09:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-22 09:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-22 09:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-22 09:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-22 09:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-22 09:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-22 09:53:14,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04124360607143587, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05793490677579528, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04124360607143587, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17458333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24233333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:14,321 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-22 09:53:14,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17944938600522867, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04124360607143587, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05793490677579528, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04124360607143587, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17458333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24233333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-22 09:53:14,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 580 ms to try 5000 different iterations.  Found a solution that moves 2644 regions; Going from a computed imbalance of 0.17944938600522867 to a new imbalance of 0.01583511508437835. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024305800062903556); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03938072816545868, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2937777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024305800062903556); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:14,760 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1698492794:76 , srv857237868:76 , srv2112258722:77 , srv651451882:78 , srv1010144606:79 , srv500082423:79 , srv1875139432:80 , srv349675897:80 , srv235962616:81 , srv1243533079:82 , srv1510686851:82 , srv1688899597:82 , srv1695399482:82 , srv1792444410:82 , srv19062361:82 , srv1987143550:82 , srv444503714:82 , srv646155790:82 , srv7757095:82 , srv1013933676:83 , srv1149011964:83 , srv1354619694:83 , srv1377981688:83 , srv1732852512:83 , srv225934187:83 , srv369588989:83 , srv778745553:83 , srv1131927689:84 , srv1273765581:84 , srv1725085256:84 , srv1814960362:84 , srv1897466589:84 , srv1918841006:84 , srv2051449315:84 , srv365337041:84 , srv396149180:84 , srv487226193:84 , srv795422431:84 , srv84995593:84 , srv980119433:84 , srv1377475830:85 , srv1554935288:85 , srv1600460979:85 , srv1626430391:85 , srv1760075747:85 , srv1902139185:85 , srv1946296907:85 , srv275422162:85 , srv339754830:85 , srv36176737:85 , srv842414962:85 , srv1178700766:86 , srv1350162180:86 , srv1477917355:86 , srv1815241482:86 , srv2090468514:86 , srv242983792:86 , srv367536508:86 , srv51899639:86 , srv655791887:86 , srv1148017461:87 , srv1470845595:87 , srv1777295923:87 , srv2031710563:87 , srv234104582:87 , srv290826721:87 , srv386133043:87 , srv703978289:87 , srv705082923:87 , srv787683233:87 , srv1109872339:88 , srv1192076238:88 , srv1809298143:88 , srv1843330901:88 , srv1921120282:88 , srv198449835:88 , srv2040546722:88 , srv392038283:88 , srv524734079:88 , srv574320760:88 , srv866900959:88 , srv1267916056:89 , srv151367718:89 , srv554556638:89 , srv1026279003:90 , srv1202738641:90 , srv1951207451:90 , srv581255468:90 , srv94393311:90 , srv1093024449:91 , srv1699289576:91 , srv2061690445:91 , srv386402361:91 , srv605380299:91 , srv1074126638:92 , srv603742025:92 , srv1865446177:93 , srv205519980:94 , srv787147431:94 , srv790107205:534 }
2023-07-22 09:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1918841006=44, srv369588989=68, srv2090468514=55, srv787147431=90, srv36176737=65, srv1178700766=9, srv500082423=75, srv2040546722=51, srv1732852512=31, srv1760075747=32, srv1554935288=23, srv778745553=89, srv1951207451=47, srv705082923=87, srv2112258722=56, srv7757095=88, srv1792444410=34, srv365337041=66, srv444503714=73, srv386133043=69, srv51899639=76, srv524734079=77, srv1109872339=5, srv1698492794=28, srv1843330901=38, srv242983792=60, srv290826721=62, srv234104582=58, srv651451882=84, srv349675897=64, srv396149180=72, srv1814960362=36, srv275422162=61, srv1470845595=19, srv655791887=85, srv795422431=93, srv84995593=95, srv1815241482=37, srv1921120282=45, srv1350162180=15, srv1688899597=26, srv392038283=71, srv1875139432=40, srv1777295923=33, srv866900959=97, srv980119433=99, srv790107205=92, srv1202738641=11, srv1699289576=29, srv1131927689=6, srv487226193=74, srv1865446177=39, srv1902139185=42, srv1600460979=24, srv1725085256=30, srv1354619694=16, srv603742025=81, srv1267916056=13, srv94393311=98, srv787683233=91, srv857237868=96, srv646155790=83, srv1897466589=41, srv842414962=94, srv19062361=43, srv2031710563=50, srv367536508=67, srv235962616=59, srv574320760=79, srv386402361=70, srv1377475830=17, srv1946296907=46, srv2051449315=52, srv1149011964=8, srv151367718=22, srv1695399482=27, srv554556638=78, srv1987143550=49, srv2061690445=54, srv1809298143=35, srv703978289=86, srv1273765581=14, srv1074126638=3, srv225934187=57, srv339754830=63, srv1377981688=18, srv581255468=80, srv205519980=53, srv1148017461=7, srv1510686851=21, srv605380299=82, srv1093024449=4, srv1477917355=20, srv198449835=48, srv1013933676=1, srv1243533079=12, srv1192076238=10, srv1626430391=25, srv1010144606=0, srv1026279003=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-22 09:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-22 09:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-22 09:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-22 09:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-22 09:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-22 09:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-22 09:53:14,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-22 09:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-22 09:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-22 09:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-22 09:53:14,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-22 09:53:14,953 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024305800062903556); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03938072816545868, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024305800062903556); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:14,953 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-22 09:53:14,953 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015816601400677453, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024305800062903556); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03938072816545868, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024305800062903556); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-22 09:53:15,239 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 404 ms to try 5000 different iterations.  Found a solution that moves 931 regions; Going from a computed imbalance of 0.015816601400677453 to a new imbalance of 8.867250956209815E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008119017409528168); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011853956042166141); MoveCostFunction : (multiplier=7.0, imbalance=0.10344444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008119017409528168); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:15,242 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1865446177:81 , srv1148017461:82 , srv51899639:82 , srv1093024449:83 , srv1149011964:83 , srv1951207451:83 , srv2040546722:83 , srv367536508:83 , srv581255468:83 , srv705082923:83 , srv787147431:83 , srv1013933676:84 , srv1178700766:84 , srv1202738641:84 , srv1350162180:84 , srv1760075747:84 , srv1792444410:84 , srv1843330901:84 , srv205519980:84 , srv234104582:84 , srv242983792:84 , srv290826721:84 , srv605380299:84 , srv651451882:84 , srv7757095:84 , srv94393311:84 , srv980119433:84 , srv1074126638:85 , srv1109872339:85 , srv1131927689:85 , srv1267916056:85 , srv1273765581:85 , srv1470845595:85 , srv1477917355:85 , srv1626430391:85 , srv1699289576:85 , srv1725085256:85 , srv1777295923:85 , srv1809298143:85 , srv1814960362:85 , srv198449835:85 , srv2031710563:85 , srv349675897:85 , srv392038283:85 , srv524734079:85 , srv574320760:85 , srv655791887:85 , srv795422431:85 , srv84995593:85 , srv866900959:85 , srv1010144606:86 , srv1192076238:86 , srv1354619694:86 , srv1377475830:86 , srv1688899597:86 , srv1695399482:86 , srv1698492794:86 , srv1875139432:86 , srv1897466589:86 , srv1918841006:86 , srv1921120282:86 , srv1946296907:86 , srv2061690445:86 , srv225934187:86 , srv235962616:86 , srv275422162:86 , srv339754830:86 , srv386402361:86 , srv444503714:86 , srv603742025:86 , srv703978289:86 , srv842414962:86 , srv1026279003:87 , srv151367718:87 , srv1554935288:87 , srv1600460979:87 , srv1732852512:87 , srv19062361:87 , srv1987143550:87 , srv2051449315:87 , srv2090468514:87 , srv2112258722:87 , srv36176737:87 , srv365337041:87 , srv386133043:87 , srv487226193:87 , srv500082423:87 , srv646155790:87 , srv787683233:87 , srv857237868:87 , srv1243533079:88 , srv1510686851:88 , srv1815241482:88 , srv1902139185:88 , srv396149180:88 , srv554556638:88 , srv778745553:88 , srv1377981688:89 , srv369588989:89 , srv790107205:540 }
2023-07-22 09:53:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1918841006=44, srv369588989=68, srv2090468514=55, srv787147431=90, srv36176737=65, srv1178700766=9, srv500082423=75, srv2040546722=51, srv1732852512=31, srv1760075747=32, srv1554935288=23, srv778745553=89, srv1951207451=47, srv705082923=87, srv2112258722=56, srv7757095=88, srv1792444410=34, srv365337041=66, srv444503714=73, srv386133043=69, srv51899639=76, srv524734079=77, srv1109872339=5, srv1698492794=28, srv1843330901=38, srv242983792=60, srv290826721=62, srv234104582=58, srv651451882=84, srv349675897=64, srv396149180=72, srv1814960362=36, srv275422162=61, srv1470845595=19, srv655791887=85, srv795422431=93, srv84995593=95, srv1815241482=37, srv1921120282=45, srv1350162180=15, srv1688899597=26, srv392038283=71, srv1875139432=40, srv1777295923=33, srv866900959=97, srv980119433=99, srv790107205=92, srv1202738641=11, srv1699289576=29, srv1131927689=6, srv487226193=74, srv1865446177=39, srv1902139185=42, srv1600460979=24, srv1725085256=30, srv1354619694=16, srv603742025=81, srv1267916056=13, srv94393311=98, srv787683233=91, srv857237868=96, srv646155790=83, srv1897466589=41, srv842414962=94, srv19062361=43, srv2031710563=50, srv367536508=67, srv235962616=59, srv574320760=79, srv386402361=70, srv1377475830=17, srv1946296907=46, srv2051449315=52, srv1149011964=8, srv151367718=22, srv1695399482=27, srv554556638=78, srv1987143550=49, srv2061690445=54, srv1809298143=35, srv703978289=86, srv1273765581=14, srv1074126638=3, srv225934187=57, srv339754830=63, srv1377981688=18, srv581255468=80, srv205519980=53, srv1148017461=7, srv1510686851=21, srv605380299=82, srv1093024449=4, srv1477917355=20, srv198449835=48, srv1013933676=1, srv1243533079=12, srv1192076238=10, srv1626430391=25, srv1010144606=0, srv1026279003=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-22 09:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-22 09:53:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-22 09:53:15,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-22 09:53:15,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-22 09:53:15,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-22 09:53:15,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-22 09:53:15,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-22 09:53:15,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-22 09:53:15,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-22 09:53:15,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-22 09:53:15,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-22 09:53:15,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-22 09:53:15,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-22 09:53:15,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008119017409528168); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011853956042166141); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008119017409528168); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:15,462 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-22 09:53:15,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.80206094287572E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008119017409528168); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011853956042166141); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008119017409528168); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-22 09:53:15,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 593 ms to try 5000 different iterations.  Found a solution that moves 302 regions; Going from a computed imbalance of 8.80206094287572E-4 to a new imbalance of 5.155718973705285E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.033555555555555554, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:15,884 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2061690445:83 , srv369588989:83 , srv524734079:83 , srv581255468:83 , srv603742025:83 , srv1093024449:84 , srv1131927689:84 , srv1192076238:84 , srv1202738641:84 , srv1243533079:84 , srv1267916056:84 , srv1273765581:84 , srv1477917355:84 , srv1510686851:84 , srv151367718:84 , srv1600460979:84 , srv1688899597:84 , srv1698492794:84 , srv1792444410:84 , srv1815241482:84 , srv1918841006:84 , srv1946296907:84 , srv2051449315:84 , srv2090468514:84 , srv2112258722:84 , srv235962616:84 , srv36176737:84 , srv365337041:84 , srv386133043:84 , srv396149180:84 , srv500082423:84 , srv574320760:84 , srv646155790:84 , srv705082923:84 , srv787147431:84 , srv787683233:84 , srv842414962:84 , srv857237868:84 , srv1010144606:85 , srv1026279003:85 , srv1074126638:85 , srv1109872339:85 , srv1148017461:85 , srv1149011964:85 , srv1350162180:85 , srv1354619694:85 , srv1377981688:85 , srv1470845595:85 , srv1626430391:85 , srv1732852512:85 , srv1760075747:85 , srv1777295923:85 , srv1809298143:85 , srv1814960362:85 , srv1843330901:85 , srv1865446177:85 , srv1875139432:85 , srv1897466589:85 , srv1902139185:85 , srv19062361:85 , srv1921120282:85 , srv1951207451:85 , srv1987143550:85 , srv205519980:85 , srv225934187:85 , srv234104582:85 , srv275422162:85 , srv290826721:85 , srv349675897:85 , srv367536508:85 , srv386402361:85 , srv444503714:85 , srv554556638:85 , srv605380299:85 , srv651451882:85 , srv655791887:85 , srv703978289:85 , srv7757095:85 , srv795422431:85 , srv84995593:85 , srv866900959:85 , srv94393311:85 , srv980119433:85 , srv1013933676:86 , srv1178700766:86 , srv1377475830:86 , srv1554935288:86 , srv1695399482:86 , srv1699289576:86 , srv1725085256:86 , srv198449835:86 , srv2031710563:86 , srv2040546722:86 , srv242983792:86 , srv339754830:86 , srv392038283:86 , srv487226193:86 , srv51899639:86 , srv778745553:86 , srv790107205:612 }
2023-07-22 09:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1918841006=44, srv369588989=68, srv2090468514=55, srv787147431=90, srv36176737=65, srv1178700766=9, srv500082423=75, srv2040546722=51, srv1732852512=31, srv1760075747=32, srv1554935288=23, srv778745553=89, srv1951207451=47, srv705082923=87, srv2112258722=56, srv7757095=88, srv1792444410=34, srv365337041=66, srv444503714=73, srv386133043=69, srv51899639=76, srv524734079=77, srv1109872339=5, srv1698492794=28, srv1843330901=38, srv242983792=60, srv290826721=62, srv234104582=58, srv651451882=84, srv349675897=64, srv396149180=72, srv1814960362=36, srv275422162=61, srv1470845595=19, srv655791887=85, srv795422431=93, srv84995593=95, srv1815241482=37, srv1921120282=45, srv1350162180=15, srv1688899597=26, srv392038283=71, srv1875139432=40, srv1777295923=33, srv866900959=97, srv980119433=99, srv790107205=92, srv1202738641=11, srv1699289576=29, srv1131927689=6, srv487226193=74, srv1865446177=39, srv1902139185=42, srv1600460979=24, srv1725085256=30, srv1354619694=16, srv603742025=81, srv1267916056=13, srv94393311=98, srv787683233=91, srv857237868=96, srv646155790=83, srv1897466589=41, srv842414962=94, srv19062361=43, srv2031710563=50, srv367536508=67, srv235962616=59, srv574320760=79, srv386402361=70, srv1377475830=17, srv1946296907=46, srv2051449315=52, srv1149011964=8, srv151367718=22, srv1695399482=27, srv554556638=78, srv1987143550=49, srv2061690445=54, srv1809298143=35, srv703978289=86, srv1273765581=14, srv1074126638=3, srv225934187=57, srv339754830=63, srv1377981688=18, srv581255468=80, srv205519980=53, srv1148017461=7, srv1510686851=21, srv605380299=82, srv1093024449=4, srv1477917355=20, srv198449835=48, srv1013933676=1, srv1243533079=12, srv1192076238=10, srv1626430391=25, srv1010144606=0, srv1026279003=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-22 09:53:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-22 09:53:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-22 09:53:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-22 09:53:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-22 09:53:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-22 09:53:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-22 09:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-22 09:53:16,038 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:16,039 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-22 09:53:16,039 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.944254053974928E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-22 09:53:16,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 421 ms to try 5000 different iterations.  Found a solution that moves 43 regions; Going from a computed imbalance of 4.944254053974928E-5 to a new imbalance of 7.374331731707109E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0047777777777777775); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:16,344 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1178700766:83 , srv1377475830:83 , srv1377981688:83 , srv1699289576:83 , srv1725085256:83 , srv2040546722:83 , srv275422162:83 , srv339754830:83 , srv655791887:83 , srv778745553:83 , srv866900959:83 , srv980119433:83 , srv1010144606:84 , srv1013933676:84 , srv1026279003:84 , srv1074126638:84 , srv1093024449:84 , srv1109872339:84 , srv1131927689:84 , srv1148017461:84 , srv1192076238:84 , srv1202738641:84 , srv1243533079:84 , srv1267916056:84 , srv1273765581:84 , srv1350162180:84 , srv1354619694:84 , srv1470845595:84 , srv1510686851:84 , srv151367718:84 , srv1554935288:84 , srv1626430391:84 , srv1688899597:84 , srv1695399482:84 , srv1732852512:84 , srv1760075747:84 , srv1777295923:84 , srv1792444410:84 , srv1809298143:84 , srv1814960362:84 , srv1815241482:84 , srv1843330901:84 , srv1865446177:84 , srv1875139432:84 , srv1897466589:84 , srv1902139185:84 , srv19062361:84 , srv1921120282:84 , srv1946296907:84 , srv1951207451:84 , srv198449835:84 , srv1987143550:84 , srv2031710563:84 , srv205519980:84 , srv2061690445:84 , srv2090468514:84 , srv225934187:84 , srv234104582:84 , srv235962616:84 , srv242983792:84 , srv290826721:84 , srv349675897:84 , srv36176737:84 , srv365337041:84 , srv367536508:84 , srv369588989:84 , srv386133043:84 , srv386402361:84 , srv392038283:84 , srv444503714:84 , srv487226193:84 , srv500082423:84 , srv51899639:84 , srv524734079:84 , srv554556638:84 , srv603742025:84 , srv605380299:84 , srv646155790:84 , srv651451882:84 , srv703978289:84 , srv705082923:84 , srv7757095:84 , srv787147431:84 , srv787683233:84 , srv84995593:84 , srv857237868:84 , srv94393311:84 , srv1149011964:85 , srv1477917355:85 , srv1600460979:85 , srv1698492794:85 , srv1918841006:85 , srv2051449315:85 , srv2112258722:85 , srv396149180:85 , srv574320760:85 , srv581255468:85 , srv795422431:85 , srv842414962:85 , srv790107205:684 }
2023-07-22 09:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1918841006=44, srv369588989=68, srv2090468514=55, srv787147431=90, srv36176737=65, srv1178700766=9, srv500082423=75, srv2040546722=51, srv1732852512=31, srv1760075747=32, srv1554935288=23, srv778745553=89, srv1951207451=47, srv705082923=87, srv2112258722=56, srv7757095=88, srv1792444410=34, srv365337041=66, srv444503714=73, srv386133043=69, srv51899639=76, srv524734079=77, srv1109872339=5, srv1698492794=28, srv1843330901=38, srv242983792=60, srv290826721=62, srv234104582=58, srv651451882=84, srv349675897=64, srv396149180=72, srv1814960362=36, srv275422162=61, srv1470845595=19, srv655791887=85, srv795422431=93, srv84995593=95, srv1815241482=37, srv1921120282=45, srv1350162180=15, srv1688899597=26, srv392038283=71, srv1875139432=40, srv1777295923=33, srv866900959=97, srv980119433=99, srv790107205=92, srv1202738641=11, srv1699289576=29, srv1131927689=6, srv487226193=74, srv1865446177=39, srv1902139185=42, srv1600460979=24, srv1725085256=30, srv1354619694=16, srv603742025=81, srv1267916056=13, srv94393311=98, srv787683233=91, srv857237868=96, srv646155790=83, srv1897466589=41, srv842414962=94, srv19062361=43, srv2031710563=50, srv367536508=67, srv235962616=59, srv574320760=79, srv386402361=70, srv1377475830=17, srv1946296907=46, srv2051449315=52, srv1149011964=8, srv151367718=22, srv1695399482=27, srv554556638=78, srv1987143550=49, srv2061690445=54, srv1809298143=35, srv703978289=86, srv1273765581=14, srv1074126638=3, srv225934187=57, srv339754830=63, srv1377981688=18, srv581255468=80, srv205519980=53, srv1148017461=7, srv1510686851=21, srv605380299=82, srv1093024449=4, srv1477917355=20, srv198449835=48, srv1013933676=1, srv1243533079=12, srv1192076238=10, srv1626430391=25, srv1010144606=0, srv1026279003=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:16,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:16,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:16,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:16,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:16,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:16,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:16,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-22 09:53:16,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-22 09:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-22 09:53:16,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-22 09:53:16,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-22 09:53:16,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-22 09:53:16,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:16,500 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1178700766:83 , srv1377475830:83 , srv1377981688:83 , srv1699289576:83 , srv1725085256:83 , srv2040546722:83 , srv275422162:83 , srv339754830:83 , srv655791887:83 , srv778745553:83 , srv866900959:83 , srv980119433:83 , srv1010144606:84 , srv1013933676:84 , srv1026279003:84 , srv1074126638:84 , srv1093024449:84 , srv1109872339:84 , srv1131927689:84 , srv1148017461:84 , srv1192076238:84 , srv1202738641:84 , srv1243533079:84 , srv1267916056:84 , srv1273765581:84 , srv1350162180:84 , srv1354619694:84 , srv1470845595:84 , srv1510686851:84 , srv151367718:84 , srv1554935288:84 , srv1626430391:84 , srv1688899597:84 , srv1695399482:84 , srv1732852512:84 , srv1760075747:84 , srv1777295923:84 , srv1792444410:84 , srv1809298143:84 , srv1814960362:84 , srv1815241482:84 , srv1843330901:84 , srv1865446177:84 , srv1875139432:84 , srv1897466589:84 , srv1902139185:84 , srv19062361:84 , srv1921120282:84 , srv1946296907:84 , srv1951207451:84 , srv198449835:84 , srv1987143550:84 , srv2031710563:84 , srv205519980:84 , srv2061690445:84 , srv2090468514:84 , srv225934187:84 , srv234104582:84 , srv235962616:84 , srv242983792:84 , srv290826721:84 , srv349675897:84 , srv36176737:84 , srv365337041:84 , srv367536508:84 , srv369588989:84 , srv386133043:84 , srv386402361:84 , srv392038283:84 , srv444503714:84 , srv487226193:84 , srv500082423:84 , srv51899639:84 , srv524734079:84 , srv554556638:84 , srv603742025:84 , srv605380299:84 , srv646155790:84 , srv651451882:84 , srv703978289:84 , srv705082923:84 , srv7757095:84 , srv787147431:84 , srv787683233:84 , srv84995593:84 , srv857237868:84 , srv94393311:84 , srv1149011964:85 , srv1477917355:85 , srv1600460979:85 , srv1698492794:85 , srv1918841006:85 , srv2051449315:85 , srv2112258722:85 , srv396149180:85 , srv574320760:85 , srv581255468:85 , srv795422431:85 , srv842414962:85 , srv790107205:684 }
2023-07-22 09:53:16,542 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=363 (was 308) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=10251 (was 11105)
2023-07-22 09:53:16,554 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=363, ProcessCount=173, AvailableMemoryMB=10250
2023-07-22 09:53:16,555 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-22 09:53:16,556 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-22 09:53:16,566 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1108510960:84 , srv1193231549:84 , srv1215289879:84 , srv1217236916:84 , srv1225578743:84 , srv1240334264:84 , srv1264026554:84 , srv1296596008:84 , srv1303698001:84 , srv1406784717:84 , srv1640356485:84 , srv1723467470:84 , srv1897744604:84 , srv1927746720:84 , srv1950353970:84 , srv2096038266:84 , srv235187169:84 , srv34928599:84 , srv389642823:84 , srv41623589:84 , srv531874517:84 , srv548103629:84 , srv577118185:84 , srv688113703:84 , srv751785896:84 , srv824087977:84 , srv927163816:84 , srv988815830:84 , srv999671230:84 , srv1569655344:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-22 09:53:16,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:53:16,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1406784717=9, srv1897744604=13, srv927163816=27, srv688113703=24, srv1240334264=5, srv1303698001=8, srv1215289879=2, srv1193231549=1, srv1950353970=15, srv41623589=20, srv2096038266=16, srv1723467470=12, srv824087977=26, srv1264026554=6, srv389642823=19, srv531874517=21, srv999671230=29, srv1640356485=11, srv1108510960=0, srv235187169=17, srv988815830=28, srv1927746720=14, srv1296596008=7, srv34928599=18, srv548103629=22, srv751785896=25, srv1569655344=10, srv1217236916=3, srv1225578743=4, srv577118185=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:53:16,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:53:16,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-22 09:53:16,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1319501745870761, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:53:16,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912608813955833, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1319501745870761, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-22 09:55:16,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5518036 different iterations.  Found a solution that moves 1864 regions; Going from a computed imbalance of 0.9912608813955833 to a new imbalance of 4.3506689887128686E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6903703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:55:16,594 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1108510960:90 , srv1193231549:90 , srv1215289879:90 , srv1217236916:90 , srv1225578743:90 , srv1240334264:90 , srv1264026554:90 , srv1296596008:90 , srv1303698001:90 , srv1406784717:90 , srv1569655344:90 , srv1640356485:90 , srv1723467470:90 , srv1897744604:90 , srv1927746720:90 , srv1950353970:90 , srv2096038266:90 , srv235187169:90 , srv34928599:90 , srv389642823:90 , srv41623589:90 , srv531874517:90 , srv548103629:90 , srv577118185:90 , srv688113703:90 , srv751785896:90 , srv824087977:90 , srv927163816:90 , srv988815830:90 , srv999671230:90 }
2023-07-22 09:55:16,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-22 09:55:16,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1406784717=9, srv1897744604=13, srv927163816=27, srv688113703=24, srv1240334264=5, srv1303698001=8, srv1215289879=2, srv1193231549=1, srv1950353970=15, srv41623589=20, srv2096038266=16, srv1723467470=12, srv824087977=26, srv1264026554=6, srv389642823=19, srv531874517=21, srv999671230=29, srv1640356485=11, srv1108510960=0, srv235187169=17, srv988815830=28, srv1927746720=14, srv1296596008=7, srv34928599=18, srv548103629=22, srv751785896=25, srv1569655344=10, srv1217236916=3, srv1225578743=4, srv577118185=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-22 09:55:16,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-22 09:55:16,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-22 09:55:16,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-22 09:55:16,616 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1108510960:90 , srv1193231549:90 , srv1215289879:90 , srv1217236916:90 , srv1225578743:90 , srv1240334264:90 , srv1264026554:90 , srv1296596008:90 , srv1303698001:90 , srv1406784717:90 , srv1569655344:90 , srv1640356485:90 , srv1723467470:90 , srv1897744604:90 , srv1927746720:90 , srv1950353970:90 , srv2096038266:90 , srv235187169:90 , srv34928599:90 , srv389642823:90 , srv41623589:90 , srv531874517:90 , srv548103629:90 , srv577118185:90 , srv688113703:90 , srv751785896:90 , srv824087977:90 , srv927163816:90 , srv988815830:90 , srv999671230:90 }
2023-07-22 09:55:16,629 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 363), ProcessCount=173 (was 173), AvailableMemoryMB=10197 (was 10250)