2023-08-21 17:53:09,597 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-21 17:53:09,921 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-21 17:53:10,044 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-21 17:53:10,108 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-21 17:53:10,116 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-21 17:53:10,131 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=171, AvailableMemoryMB=11134
2023-08-21 17:53:10,133 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-21 17:53:10,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-21 17:53:10,276 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011500904:84 , srv1034682145:84 , srv1040411524:84 , srv1065582833:84 , srv1079101829:84 , srv1091232033:84 , srv1101489919:84 , srv1113925470:84 , srv1130118054:84 , srv1161222369:84 , srv1194202739:84 , srv1199186307:84 , srv1205496940:84 , srv1226476316:84 , srv1259946511:84 , srv1312051347:84 , srv1325789199:84 , srv1371370958:84 , srv1396404174:84 , srv1405952128:84 , srv1414551652:84 , srv1440852664:84 , srv1479607004:84 , srv1487127309:84 , srv1495052586:84 , srv1502420628:84 , srv1503740805:84 , srv1513002884:84 , srv1531392899:84 , srv1547612510:84 , srv1581821924:84 , srv1675357397:84 , srv1678033789:84 , srv1779668928:84 , srv1789153309:84 , srv1808330354:84 , srv1855388038:84 , srv1856531121:84 , srv1871662291:84 , srv1900994115:84 , srv1904072651:84 , srv190837497:84 , srv1931708339:84 , srv195962110:84 , srv200165283:84 , srv201001476:84 , srv2016640327:84 , srv2029095117:84 , srv2044354439:84 , srv2053676020:84 , srv2054247956:84 , srv2059513709:84 , srv2098073908:84 , srv2110632589:84 , srv2145910284:84 , srv241022386:84 , srv279726497:84 , srv284605441:84 , srv299056691:84 , srv304878768:84 , srv325798746:84 , srv336437270:84 , srv338574090:84 , srv348250445:84 , srv362250227:84 , srv365518348:84 , srv390733419:84 , srv396725721:84 , srv518311526:84 , srv521534973:84 , srv526211696:84 , srv530898117:84 , srv557376304:84 , srv560807963:84 , srv588475055:84 , srv620529273:84 , srv630550859:84 , srv650516316:84 , srv654150017:84 , srv658660703:84 , srv667144936:84 , srv725549228:84 , srv752369157:84 , srv75977124:84 , srv795330317:84 , srv800323530:84 , srv822890854:84 , srv826545168:84 , srv835300008:84 , srv8533226:84 , srv862542888:84 , srv893490434:84 , srv917001508:84 , srv921263326:84 , srv925305581:84 , srv943877586:84 , srv963511164:84 , srv96384124:84 , srv997787585:84 , srv667341733:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-21 17:53:10,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:10,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405952128=19, srv336437270=61, srv279726497=56, srv1931708339=42, srv917001508=93, srv1678033789=32, srv1065582833=3, srv8533226=90, srv1487127309=23, srv1199186307=11, srv2053676020=49, srv325798746=60, srv338574090=62, srv667144936=80, srv725549228=82, srv921263326=94, srv997787585=99, srv2054247956=50, srv2044354439=48, srv654150017=78, srv390733419=66, srv1371370958=17, srv2110632589=53, srv2029095117=47, srv1325789199=16, srv518311526=68, srv943877586=96, srv1808330354=35, srv1079101829=4, srv893490434=92, srv650516316=77, srv1531392899=28, srv1130118054=8, srv201001476=45, srv835300008=89, srv1259946511=14, srv96384124=98, srv1789153309=34, srv75977124=84, srv530898117=71, srv348250445=63, srv1312051347=15, srv304878768=59, srv630550859=76, srv1900994115=39, srv2016640327=46, srv526211696=70, srv1396404174=18, srv1495052586=24, srv1226476316=13, srv1502420628=25, srv190837497=41, srv752369157=83, srv1904072651=40, srv365518348=65, srv1440852664=21, srv800323530=86, srv1040411524=2, srv1779668928=33, srv1205496940=12, srv1513002884=27, srv2059513709=51, srv362250227=64, srv2145910284=54, srv826545168=88, srv1034682145=1, srv862542888=91, srv658660703=79, srv1161222369=9, srv1194202739=10, srv1855388038=36, srv1581821924=30, srv241022386=55, srv299056691=58, srv588475055=74, srv822890854=87, srv396725721=67, srv925305581=95, srv1871662291=38, srv1011500904=0, srv557376304=72, srv1547612510=29, srv963511164=97, srv195962110=43, srv1479607004=22, srv560807963=73, srv620529273=75, srv1856531121=37, srv521534973=69, srv1113925470=7, srv667341733=81, srv1101489919=6, srv2098073908=52, srv1675357397=31, srv284605441=57, srv795330317=85, srv1503740805=26, srv200165283=44, srv1414551652=20, srv1091232033=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:10,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:10,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:10,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:10,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:10,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 17:53:10,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 17:53:10,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 17:53:10,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 17:53:10,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 17:53:10,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 17:53:10,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 17:53:10,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 17:53:10,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:10,587 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 17:53:10,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 17:53:10,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 575 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18177208816663665. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0390196614771738, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05400877012375475, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0390196614771738, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:11,013 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2053676020:82 , srv1161222369:83 , srv1205496940:83 , srv1495052586:83 , srv1779668928:83 , srv1855388038:83 , srv2016640327:83 , srv2054247956:83 , srv893490434:83 , srv1079101829:84 , srv1371370958:84 , srv1396404174:84 , srv1871662291:84 , srv2110632589:84 , srv279726497:84 , srv75977124:84 , srv963511164:84 , srv1101489919:85 , srv1130118054:85 , srv1325789199:85 , srv1405952128:85 , srv1479607004:85 , srv1487127309:85 , srv1531392899:85 , srv1547612510:85 , srv1675357397:85 , srv195962110:85 , srv200165283:85 , srv2029095117:85 , srv2145910284:85 , srv299056691:85 , srv588475055:85 , srv667144936:85 , srv725549228:85 , srv96384124:85 , srv1040411524:86 , srv1091232033:86 , srv1194202739:86 , srv1440852664:86 , srv1900994115:86 , srv190837497:86 , srv201001476:86 , srv284605441:86 , srv348250445:86 , srv526211696:86 , srv650516316:86 , srv752369157:86 , srv795330317:86 , srv800323530:86 , srv822890854:86 , srv917001508:86 , srv943877586:86 , srv1199186307:87 , srv1226476316:87 , srv1259946511:87 , srv1502420628:87 , srv1513002884:87 , srv1581821924:87 , srv1789153309:87 , srv1904072651:87 , srv2059513709:87 , srv241022386:87 , srv8533226:87 , srv862542888:87 , srv925305581:87 , srv1034682145:88 , srv1312051347:88 , srv1678033789:88 , srv1808330354:88 , srv2098073908:88 , srv304878768:88 , srv336437270:88 , srv362250227:88 , srv365518348:88 , srv396725721:88 , srv521534973:88 , srv530898117:88 , srv560807963:88 , srv654150017:88 , srv658660703:88 , srv826545168:88 , srv835300008:88 , srv1011500904:89 , srv1065582833:89 , srv1503740805:89 , srv2044354439:89 , srv325798746:89 , srv390733419:89 , srv518311526:89 , srv620529273:89 , srv630550859:89 , srv921263326:89 , srv997787585:89 , srv1113925470:90 , srv1414551652:90 , srv1931708339:90 , srv1856531121:91 , srv338574090:92 , srv557376304:94 , srv667341733:437 }
2023-08-21 17:53:11,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:11,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405952128=19, srv336437270=61, srv279726497=56, srv1931708339=42, srv917001508=93, srv1678033789=32, srv1065582833=3, srv8533226=90, srv1487127309=23, srv1199186307=11, srv2053676020=49, srv325798746=60, srv338574090=62, srv667144936=80, srv725549228=82, srv921263326=94, srv997787585=99, srv2054247956=50, srv2044354439=48, srv654150017=78, srv390733419=66, srv1371370958=17, srv2110632589=53, srv2029095117=47, srv1325789199=16, srv518311526=68, srv943877586=96, srv1808330354=35, srv1079101829=4, srv893490434=92, srv650516316=77, srv1531392899=28, srv1130118054=8, srv201001476=45, srv835300008=89, srv1259946511=14, srv96384124=98, srv1789153309=34, srv75977124=84, srv530898117=71, srv348250445=63, srv1312051347=15, srv304878768=59, srv630550859=76, srv1900994115=39, srv2016640327=46, srv526211696=70, srv1396404174=18, srv1495052586=24, srv1226476316=13, srv1502420628=25, srv190837497=41, srv752369157=83, srv1904072651=40, srv365518348=65, srv1440852664=21, srv800323530=86, srv1040411524=2, srv1779668928=33, srv1205496940=12, srv1513002884=27, srv2059513709=51, srv362250227=64, srv2145910284=54, srv826545168=88, srv1034682145=1, srv862542888=91, srv658660703=79, srv1161222369=9, srv1194202739=10, srv1855388038=36, srv1581821924=30, srv241022386=55, srv299056691=58, srv588475055=74, srv822890854=87, srv396725721=67, srv925305581=95, srv1871662291=38, srv1011500904=0, srv557376304=72, srv1547612510=29, srv963511164=97, srv195962110=43, srv1479607004=22, srv560807963=73, srv620529273=75, srv1856531121=37, srv521534973=69, srv1113925470=7, srv667341733=81, srv1101489919=6, srv2098073908=52, srv1675357397=31, srv284605441=57, srv795330317=85, srv1503740805=26, srv200165283=44, srv1414551652=20, srv1091232033=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:11,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:11,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:11,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 17:53:11,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 17:53:11,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 17:53:11,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 17:53:11,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 17:53:11,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 17:53:11,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 17:53:11,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 17:53:11,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 17:53:11,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 17:53:11,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 17:53:11,187 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0390196614771738, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05400877012375475, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0390196614771738, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:11,187 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 17:53:11,187 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18173921307398322, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0390196614771738, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05400877012375475, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0390196614771738, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 17:53:11,582 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 502 ms to try 5000 different iterations.  Found a solution that moves 2658 regions; Going from a computed imbalance of 0.18173921307398322 to a new imbalance of 0.013235789526502485. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020036131473154375); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03147692579435806, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29533333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020036131473154375); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:11,602 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1856531121:79 , srv338574090:81 , srv1414551652:82 , srv1931708339:82 , srv2044354439:82 , srv325798746:82 , srv560807963:82 , srv1011500904:83 , srv1065582833:83 , srv1503740805:83 , srv1678033789:83 , srv1808330354:83 , srv2059513709:83 , srv2098073908:83 , srv336437270:83 , srv557376304:83 , srv620529273:83 , srv630550859:83 , srv658660703:83 , srv826545168:83 , srv835300008:83 , srv1034682145:84 , srv1259946511:84 , srv390733419:84 , srv396725721:84 , srv518311526:84 , srv530898117:84 , srv997787585:84 , srv1091232033:85 , srv1502420628:85 , srv1581821924:85 , srv1789153309:85 , srv1904072651:85 , srv201001476:85 , srv304878768:85 , srv348250445:85 , srv362250227:85 , srv365518348:85 , srv650516316:85 , srv654150017:85 , srv752369157:85 , srv800323530:85 , srv8533226:85 , srv921263326:85 , srv943877586:85 , srv1079101829:86 , srv1113925470:86 , srv1194202739:86 , srv1199186307:86 , srv1226476316:86 , srv1312051347:86 , srv1479607004:86 , srv1487127309:86 , srv1513002884:86 , srv1531392899:86 , srv1900994115:86 , srv190837497:86 , srv241022386:86 , srv284605441:86 , srv521534973:86 , srv75977124:86 , srv795330317:86 , srv862542888:86 , srv917001508:86 , srv96384124:86 , srv1040411524:87 , srv1405952128:87 , srv1547612510:87 , srv1675357397:87 , srv195962110:87 , srv200165283:87 , srv2029095117:87 , srv2110632589:87 , srv299056691:87 , srv526211696:87 , srv588475055:87 , srv893490434:87 , srv925305581:87 , srv1101489919:88 , srv1130118054:88 , srv1161222369:88 , srv1205496940:88 , srv1371370958:88 , srv1440852664:88 , srv1495052586:88 , srv1779668928:88 , srv725549228:88 , srv822890854:88 , srv963511164:88 , srv1871662291:89 , srv2053676020:89 , srv2054247956:89 , srv2145910284:89 , srv667144936:89 , srv1396404174:90 , srv279726497:90 , srv1325789199:91 , srv1855388038:92 , srv2016640327:93 , srv667341733:515 }
2023-08-21 17:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405952128=19, srv336437270=61, srv279726497=56, srv1931708339=42, srv917001508=93, srv1678033789=32, srv1065582833=3, srv8533226=90, srv1487127309=23, srv1199186307=11, srv2053676020=49, srv325798746=60, srv338574090=62, srv667144936=80, srv725549228=82, srv921263326=94, srv997787585=99, srv2054247956=50, srv2044354439=48, srv654150017=78, srv390733419=66, srv1371370958=17, srv2110632589=53, srv2029095117=47, srv1325789199=16, srv518311526=68, srv943877586=96, srv1808330354=35, srv1079101829=4, srv893490434=92, srv650516316=77, srv1531392899=28, srv1130118054=8, srv201001476=45, srv835300008=89, srv1259946511=14, srv96384124=98, srv1789153309=34, srv75977124=84, srv530898117=71, srv348250445=63, srv1312051347=15, srv304878768=59, srv630550859=76, srv1900994115=39, srv2016640327=46, srv526211696=70, srv1396404174=18, srv1495052586=24, srv1226476316=13, srv1502420628=25, srv190837497=41, srv752369157=83, srv1904072651=40, srv365518348=65, srv1440852664=21, srv800323530=86, srv1040411524=2, srv1779668928=33, srv1205496940=12, srv1513002884=27, srv2059513709=51, srv362250227=64, srv2145910284=54, srv826545168=88, srv1034682145=1, srv862542888=91, srv658660703=79, srv1161222369=9, srv1194202739=10, srv1855388038=36, srv1581821924=30, srv241022386=55, srv299056691=58, srv588475055=74, srv822890854=87, srv396725721=67, srv925305581=95, srv1871662291=38, srv1011500904=0, srv557376304=72, srv1547612510=29, srv963511164=97, srv195962110=43, srv1479607004=22, srv560807963=73, srv620529273=75, srv1856531121=37, srv521534973=69, srv1113925470=7, srv667341733=81, srv1101489919=6, srv2098073908=52, srv1675357397=31, srv284605441=57, srv795330317=85, srv1503740805=26, srv200165283=44, srv1414551652=20, srv1091232033=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:11,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:11,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:11,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 17:53:11,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 17:53:11,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 17:53:11,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 17:53:11,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 17:53:11,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 17:53:11,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 17:53:11,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 17:53:11,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 17:53:11,805 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020036131473154375); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03147692579435806, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020036131473154375); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:11,806 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 17:53:11,806 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01321717781270635, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020036131473154375); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03147692579435806, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020036131473154375); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 17:53:12,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 486 ms to try 5000 different iterations.  Found a solution that moves 964 regions; Going from a computed imbalance of 0.01321717781270635 to a new imbalance of 6.048108411554742E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004655483366657976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062135581815069485); MoveCostFunction : (multiplier=7.0, imbalance=0.10711111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004655483366657976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:12,152 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv557376304:81 , srv1113925470:82 , srv2016640327:82 , srv521534973:82 , srv1312051347:83 , srv1325789199:83 , srv1440852664:83 , srv2145910284:83 , srv279726497:83 , srv822890854:83 , srv1226476316:84 , srv1396404174:84 , srv1855388038:84 , srv1871662291:84 , srv304878768:84 , srv362250227:84 , srv518311526:84 , srv526211696:84 , srv654150017:84 , srv667144936:84 , srv862542888:84 , srv921263326:84 , srv925305581:84 , srv997787585:84 , srv1034682145:85 , srv1040411524:85 , srv1065582833:85 , srv1101489919:85 , srv1130118054:85 , srv1199186307:85 , srv1371370958:85 , srv1502420628:85 , srv1503740805:85 , srv1513002884:85 , srv1675357397:85 , srv1900994115:85 , srv1931708339:85 , srv195962110:85 , srv2029095117:85 , srv2054247956:85 , srv241022386:85 , srv338574090:85 , srv365518348:85 , srv390733419:85 , srv396725721:85 , srv530898117:85 , srv588475055:85 , srv620529273:85 , srv725549228:85 , srv795330317:85 , srv8533226:85 , srv1011500904:86 , srv1091232033:86 , srv1161222369:86 , srv1194202739:86 , srv1405952128:86 , srv1414551652:86 , srv1487127309:86 , srv1495052586:86 , srv1547612510:86 , srv1581821924:86 , srv1789153309:86 , srv1808330354:86 , srv1904072651:86 , srv190837497:86 , srv2053676020:86 , srv284605441:86 , srv299056691:86 , srv336437270:86 , srv630550859:86 , srv650516316:86 , srv658660703:86 , srv800323530:86 , srv835300008:86 , srv917001508:86 , srv963511164:86 , srv1079101829:87 , srv1205496940:87 , srv1479607004:87 , srv1531392899:87 , srv1678033789:87 , srv1856531121:87 , srv200165283:87 , srv201001476:87 , srv2044354439:87 , srv2098073908:87 , srv2110632589:87 , srv325798746:87 , srv348250445:87 , srv560807963:87 , srv752369157:87 , srv826545168:87 , srv893490434:87 , srv96384124:87 , srv1259946511:88 , srv1779668928:88 , srv2059513709:88 , srv943877586:88 , srv75977124:89 , srv667341733:547 }
2023-08-21 17:53:12,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:12,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405952128=19, srv336437270=61, srv279726497=56, srv1931708339=42, srv917001508=93, srv1678033789=32, srv1065582833=3, srv8533226=90, srv1487127309=23, srv1199186307=11, srv2053676020=49, srv325798746=60, srv338574090=62, srv667144936=80, srv725549228=82, srv921263326=94, srv997787585=99, srv2054247956=50, srv2044354439=48, srv654150017=78, srv390733419=66, srv1371370958=17, srv2110632589=53, srv2029095117=47, srv1325789199=16, srv518311526=68, srv943877586=96, srv1808330354=35, srv1079101829=4, srv893490434=92, srv650516316=77, srv1531392899=28, srv1130118054=8, srv201001476=45, srv835300008=89, srv1259946511=14, srv96384124=98, srv1789153309=34, srv75977124=84, srv530898117=71, srv348250445=63, srv1312051347=15, srv304878768=59, srv630550859=76, srv1900994115=39, srv2016640327=46, srv526211696=70, srv1396404174=18, srv1495052586=24, srv1226476316=13, srv1502420628=25, srv190837497=41, srv752369157=83, srv1904072651=40, srv365518348=65, srv1440852664=21, srv800323530=86, srv1040411524=2, srv1779668928=33, srv1205496940=12, srv1513002884=27, srv2059513709=51, srv362250227=64, srv2145910284=54, srv826545168=88, srv1034682145=1, srv862542888=91, srv658660703=79, srv1161222369=9, srv1194202739=10, srv1855388038=36, srv1581821924=30, srv241022386=55, srv299056691=58, srv588475055=74, srv822890854=87, srv396725721=67, srv925305581=95, srv1871662291=38, srv1011500904=0, srv557376304=72, srv1547612510=29, srv963511164=97, srv195962110=43, srv1479607004=22, srv560807963=73, srv620529273=75, srv1856531121=37, srv521534973=69, srv1113925470=7, srv667341733=81, srv1101489919=6, srv2098073908=52, srv1675357397=31, srv284605441=57, srv795330317=85, srv1503740805=26, srv200165283=44, srv1414551652=20, srv1091232033=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:12,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:12,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 17:53:12,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 17:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 17:53:12,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 17:53:12,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 17:53:12,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 17:53:12,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 17:53:12,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 17:53:12,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 17:53:12,299 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004655483366657976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062135581815069485); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004655483366657976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:12,300 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 17:53:12,300 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.980607688832866E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004655483366657976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062135581815069485); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004655483366657976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 17:53:12,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 558 ms to try 5000 different iterations.  Found a solution that moves 219 regions; Going from a computed imbalance of 5.980607688832866E-4 to a new imbalance of 2.6090701912071044E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.024333333333333332); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:12,757 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1779668928:82 , srv1259946511:83 , srv1325789199:83 , srv1855388038:83 , srv201001476:83 , srv75977124:83 , srv943877586:83 , srv1011500904:84 , srv1040411524:84 , srv1091232033:84 , srv1101489919:84 , srv1113925470:84 , srv1130118054:84 , srv1194202739:84 , srv1199186307:84 , srv1205496940:84 , srv1226476316:84 , srv1396404174:84 , srv1405952128:84 , srv1414551652:84 , srv1479607004:84 , srv1495052586:84 , srv1513002884:84 , srv1531392899:84 , srv1547612510:84 , srv1581821924:84 , srv1678033789:84 , srv1789153309:84 , srv190837497:84 , srv200165283:84 , srv2016640327:84 , srv2044354439:84 , srv2059513709:84 , srv2098073908:84 , srv2110632589:84 , srv241022386:84 , srv284605441:84 , srv299056691:84 , srv336437270:84 , srv338574090:84 , srv348250445:84 , srv365518348:84 , srv390733419:84 , srv630550859:84 , srv667144936:84 , srv725549228:84 , srv826545168:84 , srv917001508:84 , srv921263326:84 , srv925305581:84 , srv963511164:84 , srv96384124:84 , srv1034682145:85 , srv1065582833:85 , srv1079101829:85 , srv1161222369:85 , srv1312051347:85 , srv1371370958:85 , srv1440852664:85 , srv1487127309:85 , srv1502420628:85 , srv1503740805:85 , srv1675357397:85 , srv1808330354:85 , srv1856531121:85 , srv1871662291:85 , srv1900994115:85 , srv1904072651:85 , srv1931708339:85 , srv195962110:85 , srv2029095117:85 , srv2053676020:85 , srv2054247956:85 , srv2145910284:85 , srv279726497:85 , srv304878768:85 , srv325798746:85 , srv362250227:85 , srv396725721:85 , srv518311526:85 , srv526211696:85 , srv530898117:85 , srv557376304:85 , srv560807963:85 , srv588475055:85 , srv620529273:85 , srv650516316:85 , srv654150017:85 , srv752369157:85 , srv795330317:85 , srv800323530:85 , srv822890854:85 , srv835300008:85 , srv8533226:85 , srv862542888:85 , srv893490434:85 , srv997787585:85 , srv521534973:86 , srv658660703:86 , srv667341733:643 }
2023-08-21 17:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405952128=19, srv336437270=61, srv279726497=56, srv1931708339=42, srv917001508=93, srv1678033789=32, srv1065582833=3, srv8533226=90, srv1487127309=23, srv1199186307=11, srv2053676020=49, srv325798746=60, srv338574090=62, srv667144936=80, srv725549228=82, srv921263326=94, srv997787585=99, srv2054247956=50, srv2044354439=48, srv654150017=78, srv390733419=66, srv1371370958=17, srv2110632589=53, srv2029095117=47, srv1325789199=16, srv518311526=68, srv943877586=96, srv1808330354=35, srv1079101829=4, srv893490434=92, srv650516316=77, srv1531392899=28, srv1130118054=8, srv201001476=45, srv835300008=89, srv1259946511=14, srv96384124=98, srv1789153309=34, srv75977124=84, srv530898117=71, srv348250445=63, srv1312051347=15, srv304878768=59, srv630550859=76, srv1900994115=39, srv2016640327=46, srv526211696=70, srv1396404174=18, srv1495052586=24, srv1226476316=13, srv1502420628=25, srv190837497=41, srv752369157=83, srv1904072651=40, srv365518348=65, srv1440852664=21, srv800323530=86, srv1040411524=2, srv1779668928=33, srv1205496940=12, srv1513002884=27, srv2059513709=51, srv362250227=64, srv2145910284=54, srv826545168=88, srv1034682145=1, srv862542888=91, srv658660703=79, srv1161222369=9, srv1194202739=10, srv1855388038=36, srv1581821924=30, srv241022386=55, srv299056691=58, srv588475055=74, srv822890854=87, srv396725721=67, srv925305581=95, srv1871662291=38, srv1011500904=0, srv557376304=72, srv1547612510=29, srv963511164=97, srv195962110=43, srv1479607004=22, srv560807963=73, srv620529273=75, srv1856531121=37, srv521534973=69, srv1113925470=7, srv667341733=81, srv1101489919=6, srv2098073908=52, srv1675357397=31, srv284605441=57, srv795330317=85, srv1503740805=26, srv200165283=44, srv1414551652=20, srv1091232033=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 17:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 17:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 17:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 17:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 17:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 17:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 17:53:12,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:12,941 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 17:53:12,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.455723113654296E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 17:53:13,328 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 16 regions; Going from a computed imbalance of 2.455723113654296E-5 to a new imbalance of 7.185273690888578E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0017777777777777779); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:13,329 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1904072651:83 , srv200165283:83 , srv325798746:83 , srv557376304:83 , srv658660703:83 , srv752369157:83 , srv1011500904:84 , srv1034682145:84 , srv1040411524:84 , srv1065582833:84 , srv1079101829:84 , srv1101489919:84 , srv1113925470:84 , srv1130118054:84 , srv1161222369:84 , srv1194202739:84 , srv1199186307:84 , srv1205496940:84 , srv1259946511:84 , srv1312051347:84 , srv1325789199:84 , srv1371370958:84 , srv1396404174:84 , srv1405952128:84 , srv1414551652:84 , srv1440852664:84 , srv1479607004:84 , srv1487127309:84 , srv1502420628:84 , srv1503740805:84 , srv1513002884:84 , srv1531392899:84 , srv1547612510:84 , srv1581821924:84 , srv1675357397:84 , srv1678033789:84 , srv1789153309:84 , srv1808330354:84 , srv1855388038:84 , srv1856531121:84 , srv1871662291:84 , srv1900994115:84 , srv190837497:84 , srv1931708339:84 , srv195962110:84 , srv2016640327:84 , srv2029095117:84 , srv2044354439:84 , srv2053676020:84 , srv2054247956:84 , srv2059513709:84 , srv2098073908:84 , srv2110632589:84 , srv2145910284:84 , srv241022386:84 , srv279726497:84 , srv284605441:84 , srv299056691:84 , srv304878768:84 , srv338574090:84 , srv348250445:84 , srv362250227:84 , srv365518348:84 , srv390733419:84 , srv396725721:84 , srv518311526:84 , srv521534973:84 , srv526211696:84 , srv530898117:84 , srv560807963:84 , srv588475055:84 , srv620529273:84 , srv630550859:84 , srv650516316:84 , srv654150017:84 , srv667144936:84 , srv725549228:84 , srv75977124:84 , srv795330317:84 , srv800323530:84 , srv822890854:84 , srv826545168:84 , srv835300008:84 , srv8533226:84 , srv862542888:84 , srv893490434:84 , srv917001508:84 , srv921263326:84 , srv925305581:84 , srv943877586:84 , srv963511164:84 , srv96384124:84 , srv997787585:84 , srv1091232033:85 , srv1226476316:85 , srv1495052586:85 , srv1779668928:85 , srv201001476:85 , srv336437270:85 , srv667341733:684 }
2023-08-21 17:53:13,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:13,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405952128=19, srv336437270=61, srv279726497=56, srv1931708339=42, srv917001508=93, srv1678033789=32, srv1065582833=3, srv8533226=90, srv1487127309=23, srv1199186307=11, srv2053676020=49, srv325798746=60, srv338574090=62, srv667144936=80, srv725549228=82, srv921263326=94, srv997787585=99, srv2054247956=50, srv2044354439=48, srv654150017=78, srv390733419=66, srv1371370958=17, srv2110632589=53, srv2029095117=47, srv1325789199=16, srv518311526=68, srv943877586=96, srv1808330354=35, srv1079101829=4, srv893490434=92, srv650516316=77, srv1531392899=28, srv1130118054=8, srv201001476=45, srv835300008=89, srv1259946511=14, srv96384124=98, srv1789153309=34, srv75977124=84, srv530898117=71, srv348250445=63, srv1312051347=15, srv304878768=59, srv630550859=76, srv1900994115=39, srv2016640327=46, srv526211696=70, srv1396404174=18, srv1495052586=24, srv1226476316=13, srv1502420628=25, srv190837497=41, srv752369157=83, srv1904072651=40, srv365518348=65, srv1440852664=21, srv800323530=86, srv1040411524=2, srv1779668928=33, srv1205496940=12, srv1513002884=27, srv2059513709=51, srv362250227=64, srv2145910284=54, srv826545168=88, srv1034682145=1, srv862542888=91, srv658660703=79, srv1161222369=9, srv1194202739=10, srv1855388038=36, srv1581821924=30, srv241022386=55, srv299056691=58, srv588475055=74, srv822890854=87, srv396725721=67, srv925305581=95, srv1871662291=38, srv1011500904=0, srv557376304=72, srv1547612510=29, srv963511164=97, srv195962110=43, srv1479607004=22, srv560807963=73, srv620529273=75, srv1856531121=37, srv521534973=69, srv1113925470=7, srv667341733=81, srv1101489919=6, srv2098073908=52, srv1675357397=31, srv284605441=57, srv795330317=85, srv1503740805=26, srv200165283=44, srv1414551652=20, srv1091232033=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 17:53:13,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 17:53:13,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 17:53:13,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 17:53:13,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 17:53:13,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 17:53:13,507 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:13,508 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1904072651:83 , srv200165283:83 , srv325798746:83 , srv557376304:83 , srv658660703:83 , srv752369157:83 , srv1011500904:84 , srv1034682145:84 , srv1040411524:84 , srv1065582833:84 , srv1079101829:84 , srv1101489919:84 , srv1113925470:84 , srv1130118054:84 , srv1161222369:84 , srv1194202739:84 , srv1199186307:84 , srv1205496940:84 , srv1259946511:84 , srv1312051347:84 , srv1325789199:84 , srv1371370958:84 , srv1396404174:84 , srv1405952128:84 , srv1414551652:84 , srv1440852664:84 , srv1479607004:84 , srv1487127309:84 , srv1502420628:84 , srv1503740805:84 , srv1513002884:84 , srv1531392899:84 , srv1547612510:84 , srv1581821924:84 , srv1675357397:84 , srv1678033789:84 , srv1789153309:84 , srv1808330354:84 , srv1855388038:84 , srv1856531121:84 , srv1871662291:84 , srv1900994115:84 , srv190837497:84 , srv1931708339:84 , srv195962110:84 , srv2016640327:84 , srv2029095117:84 , srv2044354439:84 , srv2053676020:84 , srv2054247956:84 , srv2059513709:84 , srv2098073908:84 , srv2110632589:84 , srv2145910284:84 , srv241022386:84 , srv279726497:84 , srv284605441:84 , srv299056691:84 , srv304878768:84 , srv338574090:84 , srv348250445:84 , srv362250227:84 , srv365518348:84 , srv390733419:84 , srv396725721:84 , srv518311526:84 , srv521534973:84 , srv526211696:84 , srv530898117:84 , srv560807963:84 , srv588475055:84 , srv620529273:84 , srv630550859:84 , srv650516316:84 , srv654150017:84 , srv667144936:84 , srv725549228:84 , srv75977124:84 , srv795330317:84 , srv800323530:84 , srv822890854:84 , srv826545168:84 , srv835300008:84 , srv8533226:84 , srv862542888:84 , srv893490434:84 , srv917001508:84 , srv921263326:84 , srv925305581:84 , srv943877586:84 , srv963511164:84 , srv96384124:84 , srv997787585:84 , srv1091232033:85 , srv1226476316:85 , srv1495052586:85 , srv1779668928:85 , srv201001476:85 , srv336437270:85 , srv667341733:684 }
2023-08-21 17:53:13,550 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=10258 (was 11134)
2023-08-21 17:53:13,565 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=171, AvailableMemoryMB=10261
2023-08-21 17:53:13,566 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-21 17:53:13,566 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-21 17:53:13,578 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1046076994:84 , srv119941479:84 , srv129333152:84 , srv1325615804:84 , srv1344185301:84 , srv136419991:84 , srv1462350759:84 , srv1487335558:84 , srv1624164584:84 , srv1763314931:84 , srv1764771632:84 , srv1821046161:84 , srv1902242375:84 , srv1971292871:84 , srv199838954:84 , srv2038064732:84 , srv210178805:84 , srv286352852:84 , srv30581943:84 , srv345738738:84 , srv35320072:84 , srv415463357:84 , srv51822416:84 , srv628208718:84 , srv702398533:84 , srv78534075:84 , srv812674759:84 , srv866085643:84 , srv953754460:84 , srv1183412824:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-21 17:53:13,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:53:13,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1344185301=5, srv78534075=26, srv1487335558=8, srv702398533=25, srv2038064732=16, srv1821046161=12, srv210178805=17, srv1763314931=10, srv1971292871=14, srv1624164584=9, srv953754460=29, srv119941479=2, srv345738738=20, srv866085643=28, srv1325615804=4, srv628208718=24, srv1764771632=11, srv1046076994=0, srv1902242375=13, srv199838954=15, srv286352852=18, srv51822416=23, srv812674759=27, srv35320072=21, srv415463357=22, srv1462350759=7, srv1183412824=1, srv30581943=19, srv129333152=3, srv136419991=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:53:13,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:53:13,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:53:13,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:53:13,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-21 17:53:13,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1294230129883351, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:53:13,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912600850952156, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1294230129883351, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-21 17:55:13,602 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5649589 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.9912600850952156 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:55:13,610 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1046076994:90 , srv1183412824:90 , srv119941479:90 , srv129333152:90 , srv1325615804:90 , srv1344185301:90 , srv136419991:90 , srv1462350759:90 , srv1487335558:90 , srv1624164584:90 , srv1763314931:90 , srv1764771632:90 , srv1821046161:90 , srv1902242375:90 , srv1971292871:90 , srv199838954:90 , srv2038064732:90 , srv210178805:90 , srv286352852:90 , srv30581943:90 , srv345738738:90 , srv35320072:90 , srv415463357:90 , srv51822416:90 , srv628208718:90 , srv702398533:90 , srv78534075:90 , srv812674759:90 , srv866085643:90 , srv953754460:90 }
2023-08-21 17:55:13,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 17:55:13,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1344185301=5, srv78534075=26, srv1487335558=8, srv702398533=25, srv2038064732=16, srv1821046161=12, srv210178805=17, srv1763314931=10, srv1971292871=14, srv1624164584=9, srv953754460=29, srv119941479=2, srv345738738=20, srv866085643=28, srv1325615804=4, srv628208718=24, srv1764771632=11, srv1046076994=0, srv1902242375=13, srv199838954=15, srv286352852=18, srv51822416=23, srv812674759=27, srv35320072=21, srv415463357=22, srv1462350759=7, srv1183412824=1, srv30581943=19, srv129333152=3, srv136419991=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 17:55:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 17:55:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-21 17:55:13,628 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 17:55:13,628 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1046076994:90 , srv1183412824:90 , srv119941479:90 , srv129333152:90 , srv1325615804:90 , srv1344185301:90 , srv136419991:90 , srv1462350759:90 , srv1487335558:90 , srv1624164584:90 , srv1763314931:90 , srv1764771632:90 , srv1821046161:90 , srv1902242375:90 , srv1971292871:90 , srv199838954:90 , srv2038064732:90 , srv210178805:90 , srv286352852:90 , srv30581943:90 , srv345738738:90 , srv35320072:90 , srv415463357:90 , srv51822416:90 , srv628208718:90 , srv702398533:90 , srv78534075:90 , srv812674759:90 , srv866085643:90 , srv953754460:90 }
2023-08-21 17:55:13,643 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 294), ProcessCount=174 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=10207 (was 10261)