2024-04-14 00:53:15,316 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-14 00:53:15,656 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-14 00:53:15,766 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-14 00:53:15,835 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-14 00:53:15,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-14 00:53:15,866 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=170, AvailableMemoryMB=8634
2024-04-14 00:53:15,868 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-14 00:53:15,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-14 00:53:16,019 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000737436:84 , srv1009455771:84 , srv1020960849:84 , srv102287466:84 , srv1025500032:84 , srv1050389455:84 , srv1057665950:84 , srv1099035178:84 , srv1099889006:84 , srv1115754881:84 , srv122127650:84 , srv1227974926:84 , srv1231286150:84 , srv1251734296:84 , srv1281632085:84 , srv1290131349:84 , srv1309116110:84 , srv1322963485:84 , srv1332335400:84 , srv1344137135:84 , srv1421088266:84 , srv1422375351:84 , srv1437446108:84 , srv1486867141:84 , srv1495333479:84 , srv1542166058:84 , srv1571713911:84 , srv1591891974:84 , srv1611886221:84 , srv1622471150:84 , srv1650497903:84 , srv1668185828:84 , srv1678453550:84 , srv1693125754:84 , srv175053537:84 , srv1751509190:84 , srv1768179202:84 , srv1783515807:84 , srv1788150503:84 , srv1815515649:84 , srv1836400583:84 , srv1838086230:84 , srv1847619396:84 , srv1849625167:84 , srv1854348615:84 , srv1857814242:84 , srv1939469187:84 , srv194263252:84 , srv1962223650:84 , srv1974465917:84 , srv1978261036:84 , srv1983999034:84 , srv2022920982:84 , srv2055569370:84 , srv2115835883:84 , srv221183486:84 , srv236070567:84 , srv265995815:84 , srv267973365:84 , srv269975953:84 , srv281389566:84 , srv305104214:84 , srv355596264:84 , srv382177984:84 , srv402475476:84 , srv413730601:84 , srv420913773:84 , srv441395878:84 , srv454673634:84 , srv501267451:84 , srv503280031:84 , srv518709976:84 , srv558808029:84 , srv56185808:84 , srv579176428:84 , srv581553497:84 , srv58784567:84 , srv61680624:84 , srv621851729:84 , srv622717964:84 , srv65891217:84 , srv659757768:84 , srv688529548:84 , srv691254648:84 , srv740328965:84 , srv75160715:84 , srv791089993:84 , srv791891112:84 , srv800436599:84 , srv801089627:84 , srv808972446:84 , srv819202823:84 , srv828237987:84 , srv837736981:84 , srv843147539:84 , srv913605673:84 , srv920825837:84 , srv940253647:84 , srv957743926:84 , srv720790726:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-14 00:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828237987=93, srv382177984=63, srv621851729=78, srv236070567=56, srv688529548=82, srv791089993=87, srv740328965=85, srv1099035178=7, srv1322963485=17, srv1693125754=33, srv402475476=64, srv65891217=80, srv1437446108=22, srv1009455771=1, srv1847619396=42, srv1783515807=37, srv579176428=74, srv61680624=77, srv1542166058=25, srv720790726=84, srv1227974926=11, srv1571713911=26, srv1309116110=16, srv1788150503=38, srv913605673=96, srv1231286150=12, srv413730601=65, srv800436599=89, srv1939469187=46, srv58784567=76, srv581553497=75, srv1751509190=35, srv265995815=57, srv1978261036=50, srv558808029=72, srv221183486=55, srv1849625167=43, srv801089627=90, srv1974465917=49, srv1000737436=0, srv1591891974=27, srv1768179202=36, srv843147539=95, srv1332335400=18, srv1486867141=23, srv920825837=97, srv957743926=99, srv819202823=92, srv1815515649=39, srv267973365=58, srv281389566=60, srv441395878=67, srv102287466=3, srv940253647=98, srv305104214=61, srv1020960849=2, srv1650497903=30, srv501267451=69, srv1854348615=44, srv2022920982=52, srv194263252=47, srv1838086230=41, srv56185808=73, srv1281632085=14, srv1678453550=32, srv420913773=66, srv1857814242=45, srv1344137135=19, srv122127650=10, srv1099889006=8, srv503280031=70, srv1983999034=51, srv1611886221=28, srv1025500032=4, srv1422375351=21, srv791891112=88, srv1495333479=24, srv175053537=34, srv355596264=62, srv454673634=68, srv837736981=94, srv1050389455=5, srv1251734296=13, srv1962223650=48, srv75160715=86, srv622717964=79, srv1421088266=20, srv808972446=91, srv1057665950=6, srv1290131349=15, srv518709976=71, srv1668185828=31, srv659757768=81, srv1836400583=40, srv2055569370=53, srv1622471150=29, srv691254648=83, srv1115754881=9, srv2115835883=54, srv269975953=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:16,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:16,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:16,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:16,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:16,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:16,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:16,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-14 00:53:16,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-14 00:53:16,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-14 00:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-14 00:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-14 00:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-14 00:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-14 00:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-14 00:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-14 00:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-14 00:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-14 00:53:16,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-14 00:53:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-14 00:53:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-14 00:53:16,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-14 00:53:16,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-14 00:53:16,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-14 00:53:16,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-14 00:53:16,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-14 00:53:16,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-14 00:53:16,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:16,409 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-14 00:53:16,409 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-14 00:53:16,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 744 ms to try 5000 different iterations.  Found a solution that moves 4684 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18280318518624292. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04339271881192752, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05340903718028675, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5204444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04339271881192752, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:16,926 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1974465917:81 , srv441395878:81 , srv579176428:81 , srv621851729:81 , srv828237987:81 , srv1939469187:82 , srv382177984:82 , srv1495333479:83 , srv1571713911:83 , srv1668185828:83 , srv819202823:83 , srv843147539:83 , srv1115754881:84 , srv1290131349:84 , srv1486867141:84 , srv1815515649:84 , srv1838086230:84 , srv1847619396:84 , srv2115835883:84 , srv281389566:84 , srv503280031:84 , srv558808029:84 , srv913605673:84 , srv1000737436:85 , srv1009455771:85 , srv1281632085:85 , srv1309116110:85 , srv1322963485:85 , srv1978261036:85 , srv2022920982:85 , srv221183486:85 , srv269975953:85 , srv413730601:85 , srv501267451:85 , srv691254648:85 , srv791089993:85 , srv920825837:85 , srv1099889006:86 , srv1251734296:86 , srv1437446108:86 , srv1542166058:86 , srv1854348615:86 , srv1857814242:86 , srv1983999034:86 , srv2055569370:86 , srv355596264:86 , srv402475476:86 , srv420913773:86 , srv659757768:86 , srv688529548:86 , srv740328965:86 , srv808972446:86 , srv1020960849:87 , srv1025500032:87 , srv1050389455:87 , srv1057665950:87 , srv1099035178:87 , srv1227974926:87 , srv1693125754:87 , srv175053537:87 , srv1836400583:87 , srv265995815:87 , srv454673634:87 , srv56185808:87 , srv622717964:87 , srv65891217:87 , srv791891112:87 , srv801089627:87 , srv957743926:87 , srv102287466:88 , srv1344137135:88 , srv1421088266:88 , srv1650497903:88 , srv1678453550:88 , srv1751509190:88 , srv1783515807:88 , srv1788150503:88 , srv1849625167:88 , srv194263252:88 , srv236070567:88 , srv267973365:88 , srv305104214:88 , srv581553497:88 , srv61680624:88 , srv837736981:88 , srv940253647:88 , srv122127650:89 , srv1231286150:89 , srv1422375351:89 , srv1591891974:89 , srv1611886221:89 , srv1622471150:89 , srv1962223650:89 , srv518709976:89 , srv58784567:89 , srv800436599:89 , srv1332335400:90 , srv1768179202:90 , srv75160715:91 , srv720790726:476 }
2024-04-14 00:53:16,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828237987=93, srv382177984=63, srv621851729=78, srv236070567=56, srv688529548=82, srv791089993=87, srv740328965=85, srv1099035178=7, srv1322963485=17, srv1693125754=33, srv402475476=64, srv65891217=80, srv1437446108=22, srv1009455771=1, srv1847619396=42, srv1783515807=37, srv579176428=74, srv61680624=77, srv1542166058=25, srv720790726=84, srv1227974926=11, srv1571713911=26, srv1309116110=16, srv1788150503=38, srv913605673=96, srv1231286150=12, srv413730601=65, srv800436599=89, srv1939469187=46, srv58784567=76, srv581553497=75, srv1751509190=35, srv265995815=57, srv1978261036=50, srv558808029=72, srv221183486=55, srv1849625167=43, srv801089627=90, srv1974465917=49, srv1000737436=0, srv1591891974=27, srv1768179202=36, srv843147539=95, srv1332335400=18, srv1486867141=23, srv920825837=97, srv957743926=99, srv819202823=92, srv1815515649=39, srv267973365=58, srv281389566=60, srv441395878=67, srv102287466=3, srv940253647=98, srv305104214=61, srv1020960849=2, srv1650497903=30, srv501267451=69, srv1854348615=44, srv2022920982=52, srv194263252=47, srv1838086230=41, srv56185808=73, srv1281632085=14, srv1678453550=32, srv420913773=66, srv1857814242=45, srv1344137135=19, srv122127650=10, srv1099889006=8, srv503280031=70, srv1983999034=51, srv1611886221=28, srv1025500032=4, srv1422375351=21, srv791891112=88, srv1495333479=24, srv175053537=34, srv355596264=62, srv454673634=68, srv837736981=94, srv1050389455=5, srv1251734296=13, srv1962223650=48, srv75160715=86, srv622717964=79, srv1421088266=20, srv808972446=91, srv1057665950=6, srv1290131349=15, srv518709976=71, srv1668185828=31, srv659757768=81, srv1836400583=40, srv2055569370=53, srv1622471150=29, srv691254648=83, srv1115754881=9, srv2115835883=54, srv269975953=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:16,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:16,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-14 00:53:16,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-14 00:53:16,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-14 00:53:16,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-14 00:53:16,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-14 00:53:16,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-14 00:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-14 00:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-14 00:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-14 00:53:17,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04339271881192752, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05340903718028675, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04339271881192752, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:17,189 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-14 00:53:17,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18277038711723573, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04339271881192752, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05340903718028675, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04339271881192752, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-14 00:53:17,535 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 539 ms to try 5000 different iterations.  Found a solution that moves 2592 regions; Going from a computed imbalance of 0.18277038711723573 to a new imbalance of 0.018018252446292012. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023504529363742824); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03364500753435095, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.288, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023504529363742824); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.047, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:17,549 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1332335400:80 , srv1421088266:81 , srv1422375351:81 , srv1768179202:81 , srv1231286150:82 , srv1622471150:82 , srv1650497903:82 , srv1693125754:82 , srv1751509190:82 , srv194263252:82 , srv236070567:82 , srv581553497:82 , srv58784567:82 , srv75160715:82 , srv122127650:83 , srv1591891974:83 , srv1678453550:83 , srv1783515807:83 , srv1962223650:83 , srv267973365:83 , srv61680624:83 , srv791891112:83 , srv800436599:83 , srv1025500032:84 , srv1251734296:84 , srv1344137135:84 , srv1542166058:84 , srv1611886221:84 , srv1788150503:84 , srv1836400583:84 , srv1854348615:84 , srv454673634:84 , srv518709976:84 , srv837736981:84 , srv102287466:85 , srv1050389455:85 , srv1057665950:85 , srv1281632085:85 , srv1849625167:85 , srv2055569370:85 , srv265995815:85 , srv659757768:85 , srv1020960849:86 , srv1227974926:86 , srv1437446108:86 , srv1857814242:86 , srv221183486:86 , srv281389566:86 , srv305104214:86 , srv355596264:86 , srv402475476:86 , srv501267451:86 , srv558808029:86 , srv622717964:86 , srv65891217:86 , srv688529548:86 , srv940253647:86 , srv957743926:86 , srv1000737436:87 , srv1009455771:87 , srv1099035178:87 , srv1309116110:87 , srv1668185828:87 , srv175053537:87 , srv1838086230:87 , srv413730601:87 , srv420913773:87 , srv503280031:87 , srv56185808:87 , srv691254648:87 , srv791089993:87 , srv801089627:87 , srv808972446:87 , srv1099889006:88 , srv1115754881:88 , srv1290131349:88 , srv1322963485:88 , srv1847619396:88 , srv1983999034:88 , srv2115835883:88 , srv269975953:88 , srv740328965:88 , srv843147539:88 , srv920825837:88 , srv1486867141:89 , srv1571713911:89 , srv1815515649:89 , srv1939469187:89 , srv1978261036:89 , srv819202823:89 , srv1495333479:90 , srv1974465917:90 , srv382177984:90 , srv828237987:90 , srv913605673:90 , srv2022920982:91 , srv441395878:91 , srv579176428:91 , srv621851729:93 , srv720790726:507 }
2024-04-14 00:53:17,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:17,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828237987=93, srv382177984=63, srv621851729=78, srv236070567=56, srv688529548=82, srv791089993=87, srv740328965=85, srv1099035178=7, srv1322963485=17, srv1693125754=33, srv402475476=64, srv65891217=80, srv1437446108=22, srv1009455771=1, srv1847619396=42, srv1783515807=37, srv579176428=74, srv61680624=77, srv1542166058=25, srv720790726=84, srv1227974926=11, srv1571713911=26, srv1309116110=16, srv1788150503=38, srv913605673=96, srv1231286150=12, srv413730601=65, srv800436599=89, srv1939469187=46, srv58784567=76, srv581553497=75, srv1751509190=35, srv265995815=57, srv1978261036=50, srv558808029=72, srv221183486=55, srv1849625167=43, srv801089627=90, srv1974465917=49, srv1000737436=0, srv1591891974=27, srv1768179202=36, srv843147539=95, srv1332335400=18, srv1486867141=23, srv920825837=97, srv957743926=99, srv819202823=92, srv1815515649=39, srv267973365=58, srv281389566=60, srv441395878=67, srv102287466=3, srv940253647=98, srv305104214=61, srv1020960849=2, srv1650497903=30, srv501267451=69, srv1854348615=44, srv2022920982=52, srv194263252=47, srv1838086230=41, srv56185808=73, srv1281632085=14, srv1678453550=32, srv420913773=66, srv1857814242=45, srv1344137135=19, srv122127650=10, srv1099889006=8, srv503280031=70, srv1983999034=51, srv1611886221=28, srv1025500032=4, srv1422375351=21, srv791891112=88, srv1495333479=24, srv175053537=34, srv355596264=62, srv454673634=68, srv837736981=94, srv1050389455=5, srv1251734296=13, srv1962223650=48, srv75160715=86, srv622717964=79, srv1421088266=20, srv808972446=91, srv1057665950=6, srv1290131349=15, srv518709976=71, srv1668185828=31, srv659757768=81, srv1836400583=40, srv2055569370=53, srv1622471150=29, srv691254648=83, srv1115754881=9, srv2115835883=54, srv269975953=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:17,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:17,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:17,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:17,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-14 00:53:17,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-14 00:53:17,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-14 00:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-14 00:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-14 00:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-14 00:53:17,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-14 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-14 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-14 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-14 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-14 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-14 00:53:17,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-14 00:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-14 00:53:17,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-14 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-14 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-14 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-14 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-14 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-14 00:53:17,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-14 00:53:17,766 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023504529363742824); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03364500753435095, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023504529363742824); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.047, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:17,766 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-14 00:53:17,766 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.018000102874373435, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023504529363742824); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03364500753435095, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023504529363742824); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.047, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-14 00:53:18,184 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 545 ms to try 5000 different iterations.  Found a solution that moves 998 regions; Going from a computed imbalance of 0.018000102874373435 to a new imbalance of 0.001209709176623522. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006089903001559224); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007339758434175737); MoveCostFunction : (multiplier=7.0, imbalance=0.11088888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006089903001559224); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:18,187 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2022920982:81 , srv1099035178:83 , srv1099889006:83 , srv1495333479:83 , srv1978261036:83 , srv305104214:83 , srv56185808:83 , srv913605673:83 , srv102287466:84 , srv1227974926:84 , srv175053537:84 , srv1983999034:84 , srv420913773:84 , srv518709976:84 , srv621851729:84 , srv740328965:84 , srv801089627:84 , srv940253647:84 , srv1009455771:85 , srv1020960849:85 , srv1057665950:85 , srv122127650:85 , srv1290131349:85 , srv1309116110:85 , srv1322963485:85 , srv1344137135:85 , srv1437446108:85 , srv1611886221:85 , srv1788150503:85 , srv1815515649:85 , srv1847619396:85 , srv1849625167:85 , srv1857814242:85 , srv1962223650:85 , srv2115835883:85 , srv265995815:85 , srv269975953:85 , srv355596264:85 , srv402475476:85 , srv579176428:85 , srv622717964:85 , srv65891217:85 , srv688529548:85 , srv691254648:85 , srv75160715:85 , srv800436599:85 , srv808972446:85 , srv819202823:85 , srv920825837:85 , srv957743926:85 , srv1000737436:86 , srv1025500032:86 , srv1050389455:86 , srv1115754881:86 , srv1231286150:86 , srv1486867141:86 , srv1571713911:86 , srv1591891974:86 , srv1768179202:86 , srv1974465917:86 , srv267973365:86 , srv382177984:86 , srv413730601:86 , srv441395878:86 , srv503280031:86 , srv58784567:86 , srv659757768:86 , srv791089993:86 , srv828237987:86 , srv837736981:86 , srv1281632085:87 , srv1332335400:87 , srv1542166058:87 , srv1622471150:87 , srv1650497903:87 , srv1668185828:87 , srv1678453550:87 , srv1751509190:87 , srv1783515807:87 , srv1836400583:87 , srv1838086230:87 , srv1854348615:87 , srv1939469187:87 , srv194263252:87 , srv2055569370:87 , srv221183486:87 , srv236070567:87 , srv281389566:87 , srv454673634:87 , srv501267451:87 , srv558808029:87 , srv61680624:87 , srv843147539:87 , srv1251734296:88 , srv1421088266:88 , srv1422375351:88 , srv1693125754:88 , srv581553497:88 , srv791891112:88 , srv720790726:529 }
2024-04-14 00:53:18,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:18,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828237987=93, srv382177984=63, srv621851729=78, srv236070567=56, srv688529548=82, srv791089993=87, srv740328965=85, srv1099035178=7, srv1322963485=17, srv1693125754=33, srv402475476=64, srv65891217=80, srv1437446108=22, srv1009455771=1, srv1847619396=42, srv1783515807=37, srv579176428=74, srv61680624=77, srv1542166058=25, srv720790726=84, srv1227974926=11, srv1571713911=26, srv1309116110=16, srv1788150503=38, srv913605673=96, srv1231286150=12, srv413730601=65, srv800436599=89, srv1939469187=46, srv58784567=76, srv581553497=75, srv1751509190=35, srv265995815=57, srv1978261036=50, srv558808029=72, srv221183486=55, srv1849625167=43, srv801089627=90, srv1974465917=49, srv1000737436=0, srv1591891974=27, srv1768179202=36, srv843147539=95, srv1332335400=18, srv1486867141=23, srv920825837=97, srv957743926=99, srv819202823=92, srv1815515649=39, srv267973365=58, srv281389566=60, srv441395878=67, srv102287466=3, srv940253647=98, srv305104214=61, srv1020960849=2, srv1650497903=30, srv501267451=69, srv1854348615=44, srv2022920982=52, srv194263252=47, srv1838086230=41, srv56185808=73, srv1281632085=14, srv1678453550=32, srv420913773=66, srv1857814242=45, srv1344137135=19, srv122127650=10, srv1099889006=8, srv503280031=70, srv1983999034=51, srv1611886221=28, srv1025500032=4, srv1422375351=21, srv791891112=88, srv1495333479=24, srv175053537=34, srv355596264=62, srv454673634=68, srv837736981=94, srv1050389455=5, srv1251734296=13, srv1962223650=48, srv75160715=86, srv622717964=79, srv1421088266=20, srv808972446=91, srv1057665950=6, srv1290131349=15, srv518709976=71, srv1668185828=31, srv659757768=81, srv1836400583=40, srv2055569370=53, srv1622471150=29, srv691254648=83, srv1115754881=9, srv2115835883=54, srv269975953=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-14 00:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-14 00:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-14 00:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-14 00:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-14 00:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-14 00:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-14 00:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-14 00:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-14 00:53:18,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006089903001559224); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007339758434175737); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006089903001559224); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:18,370 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-14 00:53:18,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0012027210312628963, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006089903001559224); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007339758434175737); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006089903001559224); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-14 00:53:18,639 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 250 regions; Going from a computed imbalance of 0.0012027210312628963 to a new imbalance of 2.6596007046676116E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.027777777777777776, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:18,639 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1836400583:83 , srv1000737436:84 , srv1009455771:84 , srv1020960849:84 , srv1050389455:84 , srv1099889006:84 , srv1115754881:84 , srv1251734296:84 , srv1309116110:84 , srv1322963485:84 , srv1422375351:84 , srv1486867141:84 , srv1571713911:84 , srv1591891974:84 , srv1622471150:84 , srv1678453550:84 , srv1783515807:84 , srv1815515649:84 , srv1838086230:84 , srv1849625167:84 , srv1939469187:84 , srv2022920982:84 , srv2055569370:84 , srv221183486:84 , srv269975953:84 , srv382177984:84 , srv402475476:84 , srv413730601:84 , srv441395878:84 , srv454673634:84 , srv501267451:84 , srv558808029:84 , srv581553497:84 , srv61680624:84 , srv621851729:84 , srv622717964:84 , srv65891217:84 , srv740328965:84 , srv75160715:84 , srv791089993:84 , srv791891112:84 , srv801089627:84 , srv808972446:84 , srv819202823:84 , srv837736981:84 , srv843147539:84 , srv920825837:84 , srv940253647:84 , srv957743926:84 , srv102287466:85 , srv1025500032:85 , srv1099035178:85 , srv122127650:85 , srv1231286150:85 , srv1281632085:85 , srv1290131349:85 , srv1332335400:85 , srv1421088266:85 , srv1437446108:85 , srv1542166058:85 , srv1611886221:85 , srv1650497903:85 , srv1668185828:85 , srv1693125754:85 , srv175053537:85 , srv1751509190:85 , srv1768179202:85 , srv1788150503:85 , srv1847619396:85 , srv1854348615:85 , srv1857814242:85 , srv194263252:85 , srv1962223650:85 , srv1974465917:85 , srv1978261036:85 , srv1983999034:85 , srv2115835883:85 , srv236070567:85 , srv267973365:85 , srv281389566:85 , srv305104214:85 , srv355596264:85 , srv420913773:85 , srv503280031:85 , srv518709976:85 , srv56185808:85 , srv579176428:85 , srv58784567:85 , srv659757768:85 , srv688529548:85 , srv691254648:85 , srv800436599:85 , srv828237987:85 , srv913605673:85 , srv1057665950:86 , srv1227974926:86 , srv1344137135:86 , srv1495333479:86 , srv265995815:86 , srv720790726:630 }
2024-04-14 00:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828237987=93, srv382177984=63, srv621851729=78, srv236070567=56, srv688529548=82, srv791089993=87, srv740328965=85, srv1099035178=7, srv1322963485=17, srv1693125754=33, srv402475476=64, srv65891217=80, srv1437446108=22, srv1009455771=1, srv1847619396=42, srv1783515807=37, srv579176428=74, srv61680624=77, srv1542166058=25, srv720790726=84, srv1227974926=11, srv1571713911=26, srv1309116110=16, srv1788150503=38, srv913605673=96, srv1231286150=12, srv413730601=65, srv800436599=89, srv1939469187=46, srv58784567=76, srv581553497=75, srv1751509190=35, srv265995815=57, srv1978261036=50, srv558808029=72, srv221183486=55, srv1849625167=43, srv801089627=90, srv1974465917=49, srv1000737436=0, srv1591891974=27, srv1768179202=36, srv843147539=95, srv1332335400=18, srv1486867141=23, srv920825837=97, srv957743926=99, srv819202823=92, srv1815515649=39, srv267973365=58, srv281389566=60, srv441395878=67, srv102287466=3, srv940253647=98, srv305104214=61, srv1020960849=2, srv1650497903=30, srv501267451=69, srv1854348615=44, srv2022920982=52, srv194263252=47, srv1838086230=41, srv56185808=73, srv1281632085=14, srv1678453550=32, srv420913773=66, srv1857814242=45, srv1344137135=19, srv122127650=10, srv1099889006=8, srv503280031=70, srv1983999034=51, srv1611886221=28, srv1025500032=4, srv1422375351=21, srv791891112=88, srv1495333479=24, srv175053537=34, srv355596264=62, srv454673634=68, srv837736981=94, srv1050389455=5, srv1251734296=13, srv1962223650=48, srv75160715=86, srv622717964=79, srv1421088266=20, srv808972446=91, srv1057665950=6, srv1290131349=15, srv518709976=71, srv1668185828=31, srv659757768=81, srv1836400583=40, srv2055569370=53, srv1622471150=29, srv691254648=83, srv1115754881=9, srv2115835883=54, srv269975953=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-14 00:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-14 00:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-14 00:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-14 00:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-14 00:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-14 00:53:18,760 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:18,760 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-14 00:53:18,761 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.4845469631689714E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-14 00:53:19,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 342 ms to try 5000 different iterations.  Found a solution that moves 16 regions; Going from a computed imbalance of 2.4845469631689714E-5 to a new imbalance of 7.499791894871689E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0017777777777777779); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:19,009 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1057665950:83 , srv1227974926:83 , srv1344137135:83 , srv1486867141:83 , srv1611886221:83 , srv175053537:83 , srv1983999034:83 , srv265995815:83 , srv1000737436:84 , srv1020960849:84 , srv102287466:84 , srv1025500032:84 , srv1050389455:84 , srv1099035178:84 , srv1115754881:84 , srv122127650:84 , srv1231286150:84 , srv1251734296:84 , srv1281632085:84 , srv1290131349:84 , srv1322963485:84 , srv1332335400:84 , srv1421088266:84 , srv1422375351:84 , srv1437446108:84 , srv1495333479:84 , srv1542166058:84 , srv1571713911:84 , srv1591891974:84 , srv1622471150:84 , srv1650497903:84 , srv1668185828:84 , srv1678453550:84 , srv1693125754:84 , srv1751509190:84 , srv1768179202:84 , srv1783515807:84 , srv1788150503:84 , srv1815515649:84 , srv1838086230:84 , srv1847619396:84 , srv1849625167:84 , srv1854348615:84 , srv1857814242:84 , srv1939469187:84 , srv194263252:84 , srv1962223650:84 , srv1974465917:84 , srv1978261036:84 , srv2055569370:84 , srv2115835883:84 , srv221183486:84 , srv236070567:84 , srv267973365:84 , srv269975953:84 , srv281389566:84 , srv305104214:84 , srv355596264:84 , srv382177984:84 , srv413730601:84 , srv420913773:84 , srv441395878:84 , srv454673634:84 , srv501267451:84 , srv503280031:84 , srv518709976:84 , srv56185808:84 , srv579176428:84 , srv581553497:84 , srv58784567:84 , srv61680624:84 , srv621851729:84 , srv622717964:84 , srv65891217:84 , srv659757768:84 , srv688529548:84 , srv691254648:84 , srv740328965:84 , srv75160715:84 , srv791089993:84 , srv791891112:84 , srv800436599:84 , srv801089627:84 , srv808972446:84 , srv828237987:84 , srv837736981:84 , srv843147539:84 , srv913605673:84 , srv920825837:84 , srv940253647:84 , srv957743926:84 , srv1009455771:85 , srv1099889006:85 , srv1309116110:85 , srv1836400583:85 , srv2022920982:85 , srv402475476:85 , srv558808029:85 , srv819202823:85 , srv720790726:684 }
2024-04-14 00:53:19,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:19,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828237987=93, srv382177984=63, srv621851729=78, srv236070567=56, srv688529548=82, srv791089993=87, srv740328965=85, srv1099035178=7, srv1322963485=17, srv1693125754=33, srv402475476=64, srv65891217=80, srv1437446108=22, srv1009455771=1, srv1847619396=42, srv1783515807=37, srv579176428=74, srv61680624=77, srv1542166058=25, srv720790726=84, srv1227974926=11, srv1571713911=26, srv1309116110=16, srv1788150503=38, srv913605673=96, srv1231286150=12, srv413730601=65, srv800436599=89, srv1939469187=46, srv58784567=76, srv581553497=75, srv1751509190=35, srv265995815=57, srv1978261036=50, srv558808029=72, srv221183486=55, srv1849625167=43, srv801089627=90, srv1974465917=49, srv1000737436=0, srv1591891974=27, srv1768179202=36, srv843147539=95, srv1332335400=18, srv1486867141=23, srv920825837=97, srv957743926=99, srv819202823=92, srv1815515649=39, srv267973365=58, srv281389566=60, srv441395878=67, srv102287466=3, srv940253647=98, srv305104214=61, srv1020960849=2, srv1650497903=30, srv501267451=69, srv1854348615=44, srv2022920982=52, srv194263252=47, srv1838086230=41, srv56185808=73, srv1281632085=14, srv1678453550=32, srv420913773=66, srv1857814242=45, srv1344137135=19, srv122127650=10, srv1099889006=8, srv503280031=70, srv1983999034=51, srv1611886221=28, srv1025500032=4, srv1422375351=21, srv791891112=88, srv1495333479=24, srv175053537=34, srv355596264=62, srv454673634=68, srv837736981=94, srv1050389455=5, srv1251734296=13, srv1962223650=48, srv75160715=86, srv622717964=79, srv1421088266=20, srv808972446=91, srv1057665950=6, srv1290131349=15, srv518709976=71, srv1668185828=31, srv659757768=81, srv1836400583=40, srv2055569370=53, srv1622471150=29, srv691254648=83, srv1115754881=9, srv2115835883=54, srv269975953=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-14 00:53:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-14 00:53:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-14 00:53:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-14 00:53:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-14 00:53:19,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:19,143 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1057665950:83 , srv1227974926:83 , srv1344137135:83 , srv1486867141:83 , srv1611886221:83 , srv175053537:83 , srv1983999034:83 , srv265995815:83 , srv1000737436:84 , srv1020960849:84 , srv102287466:84 , srv1025500032:84 , srv1050389455:84 , srv1099035178:84 , srv1115754881:84 , srv122127650:84 , srv1231286150:84 , srv1251734296:84 , srv1281632085:84 , srv1290131349:84 , srv1322963485:84 , srv1332335400:84 , srv1421088266:84 , srv1422375351:84 , srv1437446108:84 , srv1495333479:84 , srv1542166058:84 , srv1571713911:84 , srv1591891974:84 , srv1622471150:84 , srv1650497903:84 , srv1668185828:84 , srv1678453550:84 , srv1693125754:84 , srv1751509190:84 , srv1768179202:84 , srv1783515807:84 , srv1788150503:84 , srv1815515649:84 , srv1838086230:84 , srv1847619396:84 , srv1849625167:84 , srv1854348615:84 , srv1857814242:84 , srv1939469187:84 , srv194263252:84 , srv1962223650:84 , srv1974465917:84 , srv1978261036:84 , srv2055569370:84 , srv2115835883:84 , srv221183486:84 , srv236070567:84 , srv267973365:84 , srv269975953:84 , srv281389566:84 , srv305104214:84 , srv355596264:84 , srv382177984:84 , srv413730601:84 , srv420913773:84 , srv441395878:84 , srv454673634:84 , srv501267451:84 , srv503280031:84 , srv518709976:84 , srv56185808:84 , srv579176428:84 , srv581553497:84 , srv58784567:84 , srv61680624:84 , srv621851729:84 , srv622717964:84 , srv65891217:84 , srv659757768:84 , srv688529548:84 , srv691254648:84 , srv740328965:84 , srv75160715:84 , srv791089993:84 , srv791891112:84 , srv800436599:84 , srv801089627:84 , srv808972446:84 , srv828237987:84 , srv837736981:84 , srv843147539:84 , srv913605673:84 , srv920825837:84 , srv940253647:84 , srv957743926:84 , srv1009455771:85 , srv1099889006:85 , srv1309116110:85 , srv1836400583:85 , srv2022920982:85 , srv402475476:85 , srv558808029:85 , srv819202823:85 , srv720790726:684 }
2024-04-14 00:53:19,172 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 281), ProcessCount=170 (was 170), AvailableMemoryMB=7850 (was 8634)
2024-04-14 00:53:19,181 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=170, AvailableMemoryMB=7849
2024-04-14 00:53:19,181 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-14 00:53:19,182 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-14 00:53:19,201 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003936286:84 , srv1046743866:84 , srv105822208:84 , srv1110050123:84 , srv1131877555:84 , srv1246772114:84 , srv1290418446:84 , srv1308875056:84 , srv1403524623:84 , srv1449738400:84 , srv1468486364:84 , srv1491303108:84 , srv1521612352:84 , srv1554793077:84 , srv1649052945:84 , srv1766968655:84 , srv2004565498:84 , srv282330114:84 , srv290845838:84 , srv553307132:84 , srv587916855:84 , srv645006105:84 , srv647693117:84 , srv674268596:84 , srv843420872:84 , srv914902919:84 , srv914919183:84 , srv942252951:84 , srv961205109:84 , srv477422251:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-14 00:53:19,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:53:19,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv105822208=2, srv942252951=28, srv1110050123=3, srv1468486364=10, srv477422251=19, srv1246772114=5, srv1403524623=8, srv1554793077=13, srv1308875056=7, srv1290418446=6, srv914902919=26, srv1766968655=15, srv1131877555=4, srv2004565498=16, srv290845838=18, srv914919183=27, srv282330114=17, srv645006105=22, srv961205109=29, srv674268596=24, srv1521612352=12, srv843420872=25, srv1649052945=14, srv587916855=21, srv1003936286=0, srv647693117=23, srv1449738400=9, srv1046743866=1, srv553307132=20, srv1491303108=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:53:19,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:53:19,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-14 00:53:19,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1620747484365297, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:53:19,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912703735504375, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1620747484365297, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-14 00:55:19,223 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5463628 different iterations.  Found a solution that moves 1871 regions; Going from a computed imbalance of 0.9912703735504375 to a new imbalance of 4.367007337919408E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.692962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:55:19,229 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1003936286:90 , srv1046743866:90 , srv105822208:90 , srv1110050123:90 , srv1131877555:90 , srv1246772114:90 , srv1290418446:90 , srv1308875056:90 , srv1403524623:90 , srv1449738400:90 , srv1468486364:90 , srv1491303108:90 , srv1521612352:90 , srv1554793077:90 , srv1649052945:90 , srv1766968655:90 , srv2004565498:90 , srv282330114:90 , srv290845838:90 , srv477422251:90 , srv553307132:90 , srv587916855:90 , srv645006105:90 , srv647693117:90 , srv674268596:90 , srv843420872:90 , srv914902919:90 , srv914919183:90 , srv942252951:90 , srv961205109:90 }
2024-04-14 00:55:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-14 00:55:19,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv105822208=2, srv942252951=28, srv1110050123=3, srv1468486364=10, srv477422251=19, srv1246772114=5, srv1403524623=8, srv1554793077=13, srv1308875056=7, srv1290418446=6, srv914902919=26, srv1766968655=15, srv1131877555=4, srv2004565498=16, srv290845838=18, srv914919183=27, srv282330114=17, srv645006105=22, srv961205109=29, srv674268596=24, srv1521612352=12, srv843420872=25, srv1649052945=14, srv587916855=21, srv1003936286=0, srv647693117=23, srv1449738400=9, srv1046743866=1, srv553307132=20, srv1491303108=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-14 00:55:19,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-14 00:55:19,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-14 00:55:19,246 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-14 00:55:19,246 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1003936286:90 , srv1046743866:90 , srv105822208:90 , srv1110050123:90 , srv1131877555:90 , srv1246772114:90 , srv1290418446:90 , srv1308875056:90 , srv1403524623:90 , srv1449738400:90 , srv1468486364:90 , srv1491303108:90 , srv1521612352:90 , srv1554793077:90 , srv1649052945:90 , srv1766968655:90 , srv2004565498:90 , srv282330114:90 , srv290845838:90 , srv477422251:90 , srv553307132:90 , srv587916855:90 , srv645006105:90 , srv647693117:90 , srv674268596:90 , srv843420872:90 , srv914902919:90 , srv914919183:90 , srv942252951:90 , srv961205109:90 }
2024-04-14 00:55:19,260 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 281), ProcessCount=167 (was 170), AvailableMemoryMB=7131 (was 7849)