2023-06-07 22:53:23,648 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-06-07 22:53:23,939 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-06-07 22:53:24,042 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-06-07 22:53:24,100 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-07 22:53:24,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-07 22:53:24,120 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=176, AvailableMemoryMB=1120
2023-06-07 22:53:24,122 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-07 22:53:24,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-07 22:53:24,245 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011390439:84 , srv1021151944:84 , srv107219599:84 , srv1075919607:84 , srv1084625637:84 , srv1111438029:84 , srv1134026017:84 , srv1135464630:84 , srv1168338951:84 , srv118301963:84 , srv1202226790:84 , srv1206717676:84 , srv1220449773:84 , srv1222269808:84 , srv1256103768:84 , srv1268991430:84 , srv1269430766:84 , srv1287008578:84 , srv1311186613:84 , srv1325334094:84 , srv1332423844:84 , srv1346417001:84 , srv1351836118:84 , srv1378635007:84 , srv1388317198:84 , srv1410926649:84 , srv1417791333:84 , srv1459529247:84 , srv1469916904:84 , srv1488818896:84 , srv1490995225:84 , srv1523703300:84 , srv1570582958:84 , srv1647516376:84 , srv1664437831:84 , srv1668547880:84 , srv1677351822:84 , srv1683378341:84 , srv1692816983:84 , srv1710809335:84 , srv171423543:84 , srv1773802727:84 , srv182279571:84 , srv1825119872:84 , srv1844300834:84 , srv1851129821:84 , srv1867313428:84 , srv19086965:84 , srv1920496757:84 , srv1927570598:84 , srv193675546:84 , srv1940436164:84 , srv1979399754:84 , srv2005858184:84 , srv2008063354:84 , srv2043341340:84 , srv2058314454:84 , srv2112741005:84 , srv2119194800:84 , srv2125072083:84 , srv2133396850:84 , srv219623873:84 , srv240422005:84 , srv240737439:84 , srv252051929:84 , srv252080343:84 , srv255068497:84 , srv268741659:84 , srv29103440:84 , srv297353290:84 , srv322301184:84 , srv340715575:84 , srv355548584:84 , srv374034472:84 , srv403424379:84 , srv405869700:84 , srv420322669:84 , srv425957186:84 , srv434785716:84 , srv502196633:84 , srv544823404:84 , srv576925276:84 , srv582151512:84 , srv602389423:84 , srv603038456:84 , srv61515256:84 , srv624672881:84 , srv644074349:84 , srv678265903:84 , srv684503093:84 , srv700652952:84 , srv736374114:84 , srv748225162:84 , srv750936149:84 , srv756715769:84 , srv835850400:84 , srv838913289:84 , srv897782455:84 , srv955304980:84 , srv1429378210:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-06-07 22:53:24,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:24,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168338951=8, srv374034472=74, srv1570582958=33, srv2058314454=57, srv182279571=43, srv835850400=96, srv1311186613=18, srv624672881=87, srv118301963=9, srv1867313428=47, srv955304980=99, srv405869700=76, srv1417791333=26, srv1346417001=21, srv1683378341=38, srv644074349=88, srv2112741005=58, srv576925276=82, srv544823404=81, srv219623873=62, srv678265903=89, srv700652952=91, srv750936149=94, srv2119194800=59, srv1378635007=23, srv252080343=66, srv748225162=93, srv355548584=73, srv684503093=90, srv1664437831=35, srv297353290=70, srv1268991430=15, srv502196633=80, srv340715575=72, srv1222269808=13, srv434785716=79, srv1668547880=36, srv602389423=84, srv1692816983=39, srv240422005=63, srv322301184=71, srv582151512=83, srv1677351822=37, srv19086965=48, srv1710809335=40, srv1206717676=11, srv1844300834=45, srv1920496757=49, srv2043341340=56, srv1202226790=10, srv1084625637=4, srv897782455=98, srv1287008578=17, srv1523703300=32, srv2008063354=55, srv1488818896=30, srv1256103768=14, srv1851129821=46, srv29103440=69, srv1940436164=52, srv1351836118=22, srv420322669=77, srv1410926649=25, srv252051929=65, srv1388317198=24, srv1134026017=6, srv1220449773=12, srv107219599=2, srv838913289=97, srv736374114=92, srv1825119872=44, srv268741659=68, srv61515256=86, srv2125072083=60, srv1135464630=7, srv1647516376=34, srv1927570598=50, srv425957186=78, srv756715769=95, srv193675546=51, srv2133396850=61, srv171423543=41, srv1021151944=1, srv1075919607=3, srv1269430766=16, srv1490995225=31, srv603038456=85, srv1469916904=29, srv1773802727=42, srv1332423844=20, srv1429378210=27, srv2005858184=54, srv1111438029=5, srv403424379=75, srv240737439=64, srv1979399754=53, srv1459529247=28, srv1325334094=19, srv1011390439=0, srv255068497=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:24,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:24,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:24,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-07 22:53:24,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-07 22:53:24,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-07 22:53:24,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-07 22:53:24,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-07 22:53:24,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-07 22:53:24,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-07 22:53:24,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-07 22:53:24,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:24,492 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-07 22:53:24,492 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-07 22:53:24,767 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 409 ms to try 5000 different iterations.  Found a solution that moves 4651 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18266425754421303. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051298443670343, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05901168824094101, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5167777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051298443670343, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.241, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:24,778 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2112741005:80 , srv1417791333:81 , srv252080343:81 , srv1287008578:82 , srv1979399754:82 , srv297353290:82 , srv684503093:82 , srv1134026017:83 , srv1311186613:83 , srv1410926649:83 , srv1668547880:83 , srv1683378341:83 , srv268741659:83 , srv340715575:83 , srv1135464630:84 , srv118301963:84 , srv1268991430:84 , srv1825119872:84 , srv1851129821:84 , srv2058314454:84 , srv29103440:84 , srv322301184:84 , srv602389423:84 , srv603038456:84 , srv644074349:84 , srv748225162:84 , srv1011390439:85 , srv1111438029:85 , srv1346417001:85 , srv1469916904:85 , srv1523703300:85 , srv1940436164:85 , srv252051929:85 , srv405869700:85 , srv897782455:85 , srv1021151944:86 , srv107219599:86 , srv1084625637:86 , srv1222269808:86 , srv1677351822:86 , srv1773802727:86 , srv193675546:86 , srv2125072083:86 , srv219623873:86 , srv374034472:86 , srv420322669:86 , srv425957186:86 , srv544823404:86 , srv582151512:86 , srv736374114:86 , srv1168338951:87 , srv1202226790:87 , srv1269430766:87 , srv1325334094:87 , srv1459529247:87 , srv1488818896:87 , srv1647516376:87 , srv1664437831:87 , srv1692816983:87 , srv171423543:87 , srv19086965:87 , srv2005858184:87 , srv240422005:87 , srv355548584:87 , srv576925276:87 , srv61515256:87 , srv678265903:87 , srv750936149:87 , srv955304980:87 , srv1075919607:88 , srv1256103768:88 , srv1332423844:88 , srv182279571:88 , srv1920496757:88 , srv2043341340:88 , srv403424379:88 , srv434785716:88 , srv756715769:88 , srv835850400:88 , srv838913289:88 , srv1220449773:89 , srv1378635007:89 , srv1388317198:89 , srv1927570598:89 , srv2133396850:89 , srv240737439:89 , srv700652952:89 , srv1351836118:90 , srv1570582958:90 , srv1710809335:90 , srv2008063354:90 , srv2119194800:90 , srv502196633:90 , srv1206717676:91 , srv1844300834:91 , srv624672881:91 , srv1867313428:92 , srv255068497:92 , srv1490995225:95 , srv1429378210:450 }
2023-06-07 22:53:24,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:24,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168338951=8, srv374034472=74, srv1570582958=33, srv2058314454=57, srv182279571=43, srv835850400=96, srv1311186613=18, srv624672881=87, srv118301963=9, srv1867313428=47, srv955304980=99, srv405869700=76, srv1417791333=26, srv1346417001=21, srv1683378341=38, srv644074349=88, srv2112741005=58, srv576925276=82, srv544823404=81, srv219623873=62, srv678265903=89, srv700652952=91, srv750936149=94, srv2119194800=59, srv1378635007=23, srv252080343=66, srv748225162=93, srv355548584=73, srv684503093=90, srv1664437831=35, srv297353290=70, srv1268991430=15, srv502196633=80, srv340715575=72, srv1222269808=13, srv434785716=79, srv1668547880=36, srv602389423=84, srv1692816983=39, srv240422005=63, srv322301184=71, srv582151512=83, srv1677351822=37, srv19086965=48, srv1710809335=40, srv1206717676=11, srv1844300834=45, srv1920496757=49, srv2043341340=56, srv1202226790=10, srv1084625637=4, srv897782455=98, srv1287008578=17, srv1523703300=32, srv2008063354=55, srv1488818896=30, srv1256103768=14, srv1851129821=46, srv29103440=69, srv1940436164=52, srv1351836118=22, srv420322669=77, srv1410926649=25, srv252051929=65, srv1388317198=24, srv1134026017=6, srv1220449773=12, srv107219599=2, srv838913289=97, srv736374114=92, srv1825119872=44, srv268741659=68, srv61515256=86, srv2125072083=60, srv1135464630=7, srv1647516376=34, srv1927570598=50, srv425957186=78, srv756715769=95, srv193675546=51, srv2133396850=61, srv171423543=41, srv1021151944=1, srv1075919607=3, srv1269430766=16, srv1490995225=31, srv603038456=85, srv1469916904=29, srv1773802727=42, srv1332423844=20, srv1429378210=27, srv2005858184=54, srv1111438029=5, srv403424379=75, srv240737439=64, srv1979399754=53, srv1459529247=28, srv1325334094=19, srv1011390439=0, srv255068497=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:24,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:24,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:24,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-07 22:53:24,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-07 22:53:24,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-07 22:53:24,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-07 22:53:24,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-07 22:53:24,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-07 22:53:24,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-07 22:53:24,944 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051298443670343, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05901168824094101, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051298443670343, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.241, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:24,944 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-07 22:53:24,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18263169054614461, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051298443670343, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05901168824094101, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051298443670343, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.241, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-07 22:53:25,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 2682 regions; Going from a computed imbalance of 0.18263169054614461 to a new imbalance of 0.013460863212984469. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020951907234430817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035460732143177624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.298, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020951907234430817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:25,231 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1490995225:79 , srv1867313428:80 , srv255068497:80 , srv1351836118:81 , srv1710809335:81 , srv1920496757:81 , srv624672881:81 , srv1075919607:82 , srv1206717676:82 , srv1570582958:82 , srv1927570598:82 , srv2008063354:82 , srv2133396850:82 , srv756715769:82 , srv1378635007:83 , srv1388317198:83 , srv1459529247:83 , srv1664437831:83 , srv1844300834:83 , srv193675546:83 , srv403424379:83 , srv700652952:83 , srv1202226790:84 , srv1220449773:84 , srv1332423844:84 , srv1692816983:84 , srv2119194800:84 , srv374034472:84 , srv425957186:84 , srv61515256:84 , srv1011390439:85 , srv1021151944:85 , srv1256103768:85 , srv1677351822:85 , srv182279571:85 , srv1940436164:85 , srv2125072083:85 , srv240422005:85 , srv240737439:85 , srv355548584:85 , srv420322669:85 , srv576925276:85 , srv582151512:85 , srv835850400:85 , srv838913289:85 , srv955304980:85 , srv1084625637:86 , srv1111438029:86 , srv1168338951:86 , srv1269430766:86 , srv1488818896:86 , srv1647516376:86 , srv1773802727:86 , srv1851129821:86 , srv2043341340:86 , srv219623873:86 , srv268741659:86 , srv736374114:86 , srv748225162:86 , srv750936149:86 , srv1222269808:87 , srv1268991430:87 , srv1325334094:87 , srv1668547880:87 , srv171423543:87 , srv1825119872:87 , srv405869700:87 , srv434785716:87 , srv502196633:87 , srv544823404:87 , srv602389423:87 , srv897782455:87 , srv118301963:88 , srv1469916904:88 , srv1683378341:88 , srv19086965:88 , srv252051929:88 , srv322301184:88 , srv340715575:88 , srv603038456:88 , srv678265903:88 , srv107219599:89 , srv1134026017:89 , srv1135464630:89 , srv1287008578:89 , srv1311186613:89 , srv1410926649:89 , srv1417791333:89 , srv1523703300:89 , srv1979399754:89 , srv2005858184:89 , srv297353290:89 , srv644074349:89 , srv1346417001:90 , srv2058314454:90 , srv252080343:91 , srv29103440:91 , srv684503093:92 , srv2112741005:95 , srv1429378210:510 }
2023-06-07 22:53:25,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:25,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168338951=8, srv374034472=74, srv1570582958=33, srv2058314454=57, srv182279571=43, srv835850400=96, srv1311186613=18, srv624672881=87, srv118301963=9, srv1867313428=47, srv955304980=99, srv405869700=76, srv1417791333=26, srv1346417001=21, srv1683378341=38, srv644074349=88, srv2112741005=58, srv576925276=82, srv544823404=81, srv219623873=62, srv678265903=89, srv700652952=91, srv750936149=94, srv2119194800=59, srv1378635007=23, srv252080343=66, srv748225162=93, srv355548584=73, srv684503093=90, srv1664437831=35, srv297353290=70, srv1268991430=15, srv502196633=80, srv340715575=72, srv1222269808=13, srv434785716=79, srv1668547880=36, srv602389423=84, srv1692816983=39, srv240422005=63, srv322301184=71, srv582151512=83, srv1677351822=37, srv19086965=48, srv1710809335=40, srv1206717676=11, srv1844300834=45, srv1920496757=49, srv2043341340=56, srv1202226790=10, srv1084625637=4, srv897782455=98, srv1287008578=17, srv1523703300=32, srv2008063354=55, srv1488818896=30, srv1256103768=14, srv1851129821=46, srv29103440=69, srv1940436164=52, srv1351836118=22, srv420322669=77, srv1410926649=25, srv252051929=65, srv1388317198=24, srv1134026017=6, srv1220449773=12, srv107219599=2, srv838913289=97, srv736374114=92, srv1825119872=44, srv268741659=68, srv61515256=86, srv2125072083=60, srv1135464630=7, srv1647516376=34, srv1927570598=50, srv425957186=78, srv756715769=95, srv193675546=51, srv2133396850=61, srv171423543=41, srv1021151944=1, srv1075919607=3, srv1269430766=16, srv1490995225=31, srv603038456=85, srv1469916904=29, srv1773802727=42, srv1332423844=20, srv1429378210=27, srv2005858184=54, srv1111438029=5, srv403424379=75, srv240737439=64, srv1979399754=53, srv1459529247=28, srv1325334094=19, srv1011390439=0, srv255068497=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:25,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:25,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-07 22:53:25,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-07 22:53:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-07 22:53:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-07 22:53:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-07 22:53:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-07 22:53:25,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-07 22:53:25,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020951907234430817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035460732143177624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020951907234430817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:25,415 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-07 22:53:25,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013442083447596493, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020951907234430817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035460732143177624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020951907234430817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-07 22:53:25,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 484 ms to try 5000 different iterations.  Found a solution that moves 1038 regions; Going from a computed imbalance of 0.013442083447596493 to a new imbalance of 5.059014759603159E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005325190191896699); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008408749651825215); MoveCostFunction : (multiplier=7.0, imbalance=0.11533333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005325190191896699); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:25,779 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv502196633:81 , srv107219599:82 , srv2005858184:82 , srv29103440:82 , srv1325334094:83 , srv1523703300:83 , srv19086965:83 , srv2043341340:83 , srv2058314454:83 , srv2112741005:83 , srv240737439:83 , srv434785716:83 , srv678265903:83 , srv750936149:83 , srv1206717676:84 , srv1222269808:84 , srv1269430766:84 , srv1488818896:84 , srv1490995225:84 , srv1570582958:84 , srv1647516376:84 , srv182279571:84 , srv1844300834:84 , srv2119194800:84 , srv644074349:84 , srv684503093:84 , srv1135464630:85 , srv1168338951:85 , srv118301963:85 , srv1220449773:85 , srv1256103768:85 , srv1311186613:85 , srv1332423844:85 , srv1346417001:85 , srv1378635007:85 , srv1410926649:85 , srv1469916904:85 , srv171423543:85 , srv1773802727:85 , srv2008063354:85 , srv240422005:85 , srv322301184:85 , srv544823404:85 , srv603038456:85 , srv624672881:85 , srv700652952:85 , srv835850400:85 , srv838913289:85 , srv955304980:85 , srv1021151944:86 , srv1084625637:86 , srv1111438029:86 , srv1134026017:86 , srv1202226790:86 , srv1268991430:86 , srv1287008578:86 , srv1388317198:86 , srv1683378341:86 , srv1692816983:86 , srv1710809335:86 , srv1867313428:86 , srv1927570598:86 , srv1979399754:86 , srv2125072083:86 , srv219623873:86 , srv252051929:86 , srv252080343:86 , srv255068497:86 , srv340715575:86 , srv403424379:86 , srv405869700:86 , srv582151512:86 , srv602389423:86 , srv61515256:86 , srv736374114:86 , srv897782455:86 , srv1011390439:87 , srv1351836118:87 , srv1417791333:87 , srv1459529247:87 , srv1677351822:87 , srv1825119872:87 , srv1940436164:87 , srv2133396850:87 , srv297353290:87 , srv355548584:87 , srv420322669:87 , srv576925276:87 , srv756715769:87 , srv1075919607:88 , srv1664437831:88 , srv1668547880:88 , srv1851129821:88 , srv193675546:88 , srv374034472:88 , srv425957186:88 , srv748225162:88 , srv1920496757:89 , srv268741659:89 , srv1429378210:545 }
2023-06-07 22:53:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168338951=8, srv374034472=74, srv1570582958=33, srv2058314454=57, srv182279571=43, srv835850400=96, srv1311186613=18, srv624672881=87, srv118301963=9, srv1867313428=47, srv955304980=99, srv405869700=76, srv1417791333=26, srv1346417001=21, srv1683378341=38, srv644074349=88, srv2112741005=58, srv576925276=82, srv544823404=81, srv219623873=62, srv678265903=89, srv700652952=91, srv750936149=94, srv2119194800=59, srv1378635007=23, srv252080343=66, srv748225162=93, srv355548584=73, srv684503093=90, srv1664437831=35, srv297353290=70, srv1268991430=15, srv502196633=80, srv340715575=72, srv1222269808=13, srv434785716=79, srv1668547880=36, srv602389423=84, srv1692816983=39, srv240422005=63, srv322301184=71, srv582151512=83, srv1677351822=37, srv19086965=48, srv1710809335=40, srv1206717676=11, srv1844300834=45, srv1920496757=49, srv2043341340=56, srv1202226790=10, srv1084625637=4, srv897782455=98, srv1287008578=17, srv1523703300=32, srv2008063354=55, srv1488818896=30, srv1256103768=14, srv1851129821=46, srv29103440=69, srv1940436164=52, srv1351836118=22, srv420322669=77, srv1410926649=25, srv252051929=65, srv1388317198=24, srv1134026017=6, srv1220449773=12, srv107219599=2, srv838913289=97, srv736374114=92, srv1825119872=44, srv268741659=68, srv61515256=86, srv2125072083=60, srv1135464630=7, srv1647516376=34, srv1927570598=50, srv425957186=78, srv756715769=95, srv193675546=51, srv2133396850=61, srv171423543=41, srv1021151944=1, srv1075919607=3, srv1269430766=16, srv1490995225=31, srv603038456=85, srv1469916904=29, srv1773802727=42, srv1332423844=20, srv1429378210=27, srv2005858184=54, srv1111438029=5, srv403424379=75, srv240737439=64, srv1979399754=53, srv1459529247=28, srv1325334094=19, srv1011390439=0, srv255068497=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:25,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:25,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:25,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:25,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-07 22:53:25,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-07 22:53:25,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-07 22:53:25,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-07 22:53:25,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-07 22:53:25,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-07 22:53:25,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-07 22:53:25,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-07 22:53:25,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-07 22:53:25,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-07 22:53:25,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-07 22:53:25,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-07 22:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-07 22:53:25,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-07 22:53:25,990 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005325190191896699); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008408749651825215); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005325190191896699); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:25,991 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-07 22:53:25,991 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.986332446132924E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005325190191896699); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008408749651825215); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005325190191896699); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-07 22:53:26,338 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 493 ms to try 5000 different iterations.  Found a solution that moves 226 regions; Going from a computed imbalance of 4.986332446132924E-4 to a new imbalance of 2.5838052659652442E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.025111111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:26,339 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1346417001:82 , srv171423543:83 , srv252051929:83 , srv355548584:83 , srv576925276:83 , srv1075919607:84 , srv1084625637:84 , srv1134026017:84 , srv1135464630:84 , srv1168338951:84 , srv1206717676:84 , srv1220449773:84 , srv1256103768:84 , srv1351836118:84 , srv1469916904:84 , srv1490995225:84 , srv1664437831:84 , srv1668547880:84 , srv1677351822:84 , srv182279571:84 , srv1825119872:84 , srv1844300834:84 , srv1851129821:84 , srv19086965:84 , srv1920496757:84 , srv2005858184:84 , srv2008063354:84 , srv2112741005:84 , srv2119194800:84 , srv2133396850:84 , srv219623873:84 , srv255068497:84 , srv268741659:84 , srv297353290:84 , srv374034472:84 , srv405869700:84 , srv420322669:84 , srv425957186:84 , srv434785716:84 , srv502196633:84 , srv544823404:84 , srv61515256:84 , srv624672881:84 , srv678265903:84 , srv684503093:84 , srv700652952:84 , srv736374114:84 , srv748225162:84 , srv835850400:84 , srv838913289:84 , srv897782455:84 , srv1011390439:85 , srv1021151944:85 , srv107219599:85 , srv1111438029:85 , srv118301963:85 , srv1202226790:85 , srv1222269808:85 , srv1268991430:85 , srv1269430766:85 , srv1287008578:85 , srv1311186613:85 , srv1325334094:85 , srv1332423844:85 , srv1378635007:85 , srv1388317198:85 , srv1410926649:85 , srv1417791333:85 , srv1459529247:85 , srv1488818896:85 , srv1523703300:85 , srv1647516376:85 , srv1692816983:85 , srv1710809335:85 , srv1773802727:85 , srv1867313428:85 , srv193675546:85 , srv1940436164:85 , srv1979399754:85 , srv2043341340:85 , srv2058314454:85 , srv2125072083:85 , srv240422005:85 , srv240737439:85 , srv252080343:85 , srv322301184:85 , srv340715575:85 , srv403424379:85 , srv582151512:85 , srv602389423:85 , srv603038456:85 , srv644074349:85 , srv756715769:85 , srv955304980:85 , srv1570582958:86 , srv1683378341:86 , srv1927570598:86 , srv29103440:86 , srv750936149:86 , srv1429378210:637 }
2023-06-07 22:53:26,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:26,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168338951=8, srv374034472=74, srv1570582958=33, srv2058314454=57, srv182279571=43, srv835850400=96, srv1311186613=18, srv624672881=87, srv118301963=9, srv1867313428=47, srv955304980=99, srv405869700=76, srv1417791333=26, srv1346417001=21, srv1683378341=38, srv644074349=88, srv2112741005=58, srv576925276=82, srv544823404=81, srv219623873=62, srv678265903=89, srv700652952=91, srv750936149=94, srv2119194800=59, srv1378635007=23, srv252080343=66, srv748225162=93, srv355548584=73, srv684503093=90, srv1664437831=35, srv297353290=70, srv1268991430=15, srv502196633=80, srv340715575=72, srv1222269808=13, srv434785716=79, srv1668547880=36, srv602389423=84, srv1692816983=39, srv240422005=63, srv322301184=71, srv582151512=83, srv1677351822=37, srv19086965=48, srv1710809335=40, srv1206717676=11, srv1844300834=45, srv1920496757=49, srv2043341340=56, srv1202226790=10, srv1084625637=4, srv897782455=98, srv1287008578=17, srv1523703300=32, srv2008063354=55, srv1488818896=30, srv1256103768=14, srv1851129821=46, srv29103440=69, srv1940436164=52, srv1351836118=22, srv420322669=77, srv1410926649=25, srv252051929=65, srv1388317198=24, srv1134026017=6, srv1220449773=12, srv107219599=2, srv838913289=97, srv736374114=92, srv1825119872=44, srv268741659=68, srv61515256=86, srv2125072083=60, srv1135464630=7, srv1647516376=34, srv1927570598=50, srv425957186=78, srv756715769=95, srv193675546=51, srv2133396850=61, srv171423543=41, srv1021151944=1, srv1075919607=3, srv1269430766=16, srv1490995225=31, srv603038456=85, srv1469916904=29, srv1773802727=42, srv1332423844=20, srv1429378210=27, srv2005858184=54, srv1111438029=5, srv403424379=75, srv240737439=64, srv1979399754=53, srv1459529247=28, srv1325334094=19, srv1011390439=0, srv255068497=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:26,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:26,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:26,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-07 22:53:26,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-07 22:53:26,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-07 22:53:26,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-07 22:53:26,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-07 22:53:26,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-07 22:53:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-07 22:53:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-07 22:53:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-07 22:53:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-07 22:53:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-07 22:53:26,497 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:26,497 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-07 22:53:26,497 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.4255566836504733E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-07 22:53:26,789 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 413 ms to try 5000 different iterations.  Found a solution that moves 22 regions; Going from a computed imbalance of 2.4255566836504733E-5 to a new imbalance of 5.377980718751591E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0011605177063713189); MoveCostFunction : (multiplier=7.0, imbalance=0.0024444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:26,789 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1388317198:83 , srv1683378341:83 , srv1867313428:83 , srv1927570598:83 , srv252080343:83 , srv29103440:83 , srv1011390439:84 , srv1021151944:84 , srv107219599:84 , srv1075919607:84 , srv1084625637:84 , srv1111438029:84 , srv1134026017:84 , srv1135464630:84 , srv1168338951:84 , srv118301963:84 , srv1202226790:84 , srv1220449773:84 , srv1222269808:84 , srv1256103768:84 , srv1268991430:84 , srv1269430766:84 , srv1287008578:84 , srv1311186613:84 , srv1325334094:84 , srv1332423844:84 , srv1346417001:84 , srv1351836118:84 , srv1378635007:84 , srv1410926649:84 , srv1417791333:84 , srv1459529247:84 , srv1469916904:84 , srv1488818896:84 , srv1490995225:84 , srv1523703300:84 , srv1570582958:84 , srv1647516376:84 , srv1664437831:84 , srv1668547880:84 , srv1677351822:84 , srv1692816983:84 , srv1710809335:84 , srv171423543:84 , srv1773802727:84 , srv1825119872:84 , srv1844300834:84 , srv1851129821:84 , srv19086965:84 , srv1920496757:84 , srv193675546:84 , srv1940436164:84 , srv1979399754:84 , srv2005858184:84 , srv2043341340:84 , srv2058314454:84 , srv2112741005:84 , srv2119194800:84 , srv2125072083:84 , srv2133396850:84 , srv219623873:84 , srv240422005:84 , srv240737439:84 , srv252051929:84 , srv255068497:84 , srv268741659:84 , srv297353290:84 , srv322301184:84 , srv340715575:84 , srv355548584:84 , srv374034472:84 , srv403424379:84 , srv405869700:84 , srv420322669:84 , srv425957186:84 , srv434785716:84 , srv502196633:84 , srv544823404:84 , srv576925276:84 , srv582151512:84 , srv602389423:84 , srv603038456:84 , srv644074349:84 , srv678265903:84 , srv684503093:84 , srv736374114:84 , srv748225162:84 , srv750936149:84 , srv756715769:84 , srv835850400:84 , srv838913289:84 , srv897782455:84 , srv955304980:84 , srv1206717676:85 , srv182279571:85 , srv2008063354:85 , srv61515256:85 , srv624672881:85 , srv700652952:85 , srv1429378210:684 }
2023-06-07 22:53:26,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:26,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168338951=8, srv374034472=74, srv1570582958=33, srv2058314454=57, srv182279571=43, srv835850400=96, srv1311186613=18, srv624672881=87, srv118301963=9, srv1867313428=47, srv955304980=99, srv405869700=76, srv1417791333=26, srv1346417001=21, srv1683378341=38, srv644074349=88, srv2112741005=58, srv576925276=82, srv544823404=81, srv219623873=62, srv678265903=89, srv700652952=91, srv750936149=94, srv2119194800=59, srv1378635007=23, srv252080343=66, srv748225162=93, srv355548584=73, srv684503093=90, srv1664437831=35, srv297353290=70, srv1268991430=15, srv502196633=80, srv340715575=72, srv1222269808=13, srv434785716=79, srv1668547880=36, srv602389423=84, srv1692816983=39, srv240422005=63, srv322301184=71, srv582151512=83, srv1677351822=37, srv19086965=48, srv1710809335=40, srv1206717676=11, srv1844300834=45, srv1920496757=49, srv2043341340=56, srv1202226790=10, srv1084625637=4, srv897782455=98, srv1287008578=17, srv1523703300=32, srv2008063354=55, srv1488818896=30, srv1256103768=14, srv1851129821=46, srv29103440=69, srv1940436164=52, srv1351836118=22, srv420322669=77, srv1410926649=25, srv252051929=65, srv1388317198=24, srv1134026017=6, srv1220449773=12, srv107219599=2, srv838913289=97, srv736374114=92, srv1825119872=44, srv268741659=68, srv61515256=86, srv2125072083=60, srv1135464630=7, srv1647516376=34, srv1927570598=50, srv425957186=78, srv756715769=95, srv193675546=51, srv2133396850=61, srv171423543=41, srv1021151944=1, srv1075919607=3, srv1269430766=16, srv1490995225=31, srv603038456=85, srv1469916904=29, srv1773802727=42, srv1332423844=20, srv1429378210=27, srv2005858184=54, srv1111438029=5, srv403424379=75, srv240737439=64, srv1979399754=53, srv1459529247=28, srv1325334094=19, srv1011390439=0, srv255068497=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:26,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:26,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-07 22:53:26,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-07 22:53:26,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-07 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-07 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-07 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-07 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-07 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-07 22:53:26,930 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.223933426232788E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0011605177063713189); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:26,930 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1388317198:83 , srv1683378341:83 , srv1867313428:83 , srv1927570598:83 , srv252080343:83 , srv29103440:83 , srv1011390439:84 , srv1021151944:84 , srv107219599:84 , srv1075919607:84 , srv1084625637:84 , srv1111438029:84 , srv1134026017:84 , srv1135464630:84 , srv1168338951:84 , srv118301963:84 , srv1202226790:84 , srv1220449773:84 , srv1222269808:84 , srv1256103768:84 , srv1268991430:84 , srv1269430766:84 , srv1287008578:84 , srv1311186613:84 , srv1325334094:84 , srv1332423844:84 , srv1346417001:84 , srv1351836118:84 , srv1378635007:84 , srv1410926649:84 , srv1417791333:84 , srv1459529247:84 , srv1469916904:84 , srv1488818896:84 , srv1490995225:84 , srv1523703300:84 , srv1570582958:84 , srv1647516376:84 , srv1664437831:84 , srv1668547880:84 , srv1677351822:84 , srv1692816983:84 , srv1710809335:84 , srv171423543:84 , srv1773802727:84 , srv1825119872:84 , srv1844300834:84 , srv1851129821:84 , srv19086965:84 , srv1920496757:84 , srv193675546:84 , srv1940436164:84 , srv1979399754:84 , srv2005858184:84 , srv2043341340:84 , srv2058314454:84 , srv2112741005:84 , srv2119194800:84 , srv2125072083:84 , srv2133396850:84 , srv219623873:84 , srv240422005:84 , srv240737439:84 , srv252051929:84 , srv255068497:84 , srv268741659:84 , srv297353290:84 , srv322301184:84 , srv340715575:84 , srv355548584:84 , srv374034472:84 , srv403424379:84 , srv405869700:84 , srv420322669:84 , srv425957186:84 , srv434785716:84 , srv502196633:84 , srv544823404:84 , srv576925276:84 , srv582151512:84 , srv602389423:84 , srv603038456:84 , srv644074349:84 , srv678265903:84 , srv684503093:84 , srv736374114:84 , srv748225162:84 , srv750936149:84 , srv756715769:84 , srv835850400:84 , srv838913289:84 , srv897782455:84 , srv955304980:84 , srv1206717676:85 , srv182279571:85 , srv2008063354:85 , srv61515256:85 , srv624672881:85 , srv700652952:85 , srv1429378210:684 }
2023-06-07 22:53:26,963 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 176), AvailableMemoryMB=618 (was 1120)
2023-06-07 22:53:26,972 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=176, AvailableMemoryMB=618
2023-06-07 22:53:26,973 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-07 22:53:26,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-06-07 22:53:26,987 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005177329:84 , srv1219487799:84 , srv1232484572:84 , srv1238343023:84 , srv1274502576:84 , srv1322965438:84 , srv1357347616:84 , srv1377431279:84 , srv1428151816:84 , srv1578866294:84 , srv1629015724:84 , srv1677936616:84 , srv1824571835:84 , srv1828649025:84 , srv1848751431:84 , srv1880908166:84 , srv1887951493:84 , srv236204954:84 , srv354990251:84 , srv471963036:84 , srv491024490:84 , srv698100257:84 , srv746544981:84 , srv777279352:84 , srv781323819:84 , srv859241624:84 , srv949722320:84 , srv96848093:84 , srv98967473:84 , srv394739651:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-06-07 22:53:26,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:53:26,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv394739651=19, srv1005177329=0, srv777279352=24, srv1357347616=6, srv698100257=22, srv1887951493=16, srv1219487799=1, srv491024490=21, srv96848093=28, srv1677936616=11, srv746544981=23, srv1629015724=10, srv1232484572=2, srv1428151816=8, srv1848751431=14, srv781323819=25, srv1322965438=5, srv1828649025=13, srv1578866294=9, srv1274502576=4, srv949722320=27, srv1377431279=7, srv859241624=26, srv236204954=17, srv354990251=18, srv471963036=20, srv1824571835=12, srv1880908166=15, srv98967473=29, srv1238343023=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:53:26,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:53:26,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-07 22:53:27,016 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2057772086130185, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:53:27,017 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912841440529374, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2057772086130185, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-06-07 22:55:27,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5490948 different iterations.  Found a solution that moves 1869 regions; Going from a computed imbalance of 0.9912841440529374 to a new imbalance of 4.362339238146111E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6922222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:55:27,010 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1005177329:90 , srv1219487799:90 , srv1232484572:90 , srv1238343023:90 , srv1274502576:90 , srv1322965438:90 , srv1357347616:90 , srv1377431279:90 , srv1428151816:90 , srv1578866294:90 , srv1629015724:90 , srv1677936616:90 , srv1824571835:90 , srv1828649025:90 , srv1848751431:90 , srv1880908166:90 , srv1887951493:90 , srv236204954:90 , srv354990251:90 , srv394739651:90 , srv471963036:90 , srv491024490:90 , srv698100257:90 , srv746544981:90 , srv777279352:90 , srv781323819:90 , srv859241624:90 , srv949722320:90 , srv96848093:90 , srv98967473:90 }
2023-06-07 22:55:27,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-07 22:55:27,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv394739651=19, srv1005177329=0, srv777279352=24, srv1357347616=6, srv698100257=22, srv1887951493=16, srv1219487799=1, srv491024490=21, srv96848093=28, srv1677936616=11, srv746544981=23, srv1629015724=10, srv1232484572=2, srv1428151816=8, srv1848751431=14, srv781323819=25, srv1322965438=5, srv1828649025=13, srv1578866294=9, srv1274502576=4, srv949722320=27, srv1377431279=7, srv859241624=26, srv236204954=17, srv354990251=18, srv471963036=20, srv1824571835=12, srv1880908166=15, srv98967473=29, srv1238343023=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-07 22:55:27,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-07 22:55:27,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-07 22:55:27,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-07 22:55:27,029 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1005177329:90 , srv1219487799:90 , srv1232484572:90 , srv1238343023:90 , srv1274502576:90 , srv1322965438:90 , srv1357347616:90 , srv1377431279:90 , srv1428151816:90 , srv1578866294:90 , srv1629015724:90 , srv1677936616:90 , srv1824571835:90 , srv1828649025:90 , srv1848751431:90 , srv1880908166:90 , srv1887951493:90 , srv236204954:90 , srv354990251:90 , srv394739651:90 , srv471963036:90 , srv491024490:90 , srv698100257:90 , srv746544981:90 , srv777279352:90 , srv781323819:90 , srv859241624:90 , srv949722320:90 , srv96848093:90 , srv98967473:90 }
2023-06-07 22:55:27,042 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=300 (was 346), ProcessCount=171 (was 176), AvailableMemoryMB=972 (was 618) - AvailableMemoryMB LEAK? -