2023-11-13 04:55:12,080 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-13 04:55:12,348 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-13 04:55:12,447 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-13 04:55:12,505 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-13 04:55:12,511 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-13 04:55:12,524 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=167, AvailableMemoryMB=3397
2023-11-13 04:55:12,526 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-13 04:55:12,526 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-13 04:55:12,649 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005453905:84 , srv1027198773:84 , srv1040665481:84 , srv1041806281:84 , srv1047279989:84 , srv1066671861:84 , srv1078270408:84 , srv109295006:84 , srv1099517722:84 , srv1105087040:84 , srv1141201468:84 , srv1210896528:84 , srv1249508875:84 , srv1283284329:84 , srv1301031800:84 , srv1316934376:84 , srv1339442215:84 , srv1405552958:84 , srv1466785643:84 , srv1497487666:84 , srv1499692376:84 , srv1515643962:84 , srv1518293270:84 , srv1539874760:84 , srv1580228773:84 , srv1582224904:84 , srv1584747719:84 , srv1586673351:84 , srv1615218848:84 , srv1617770611:84 , srv1641891280:84 , srv1655361934:84 , srv1658975934:84 , srv1683265793:84 , srv1706331876:84 , srv1709094589:84 , srv1738903751:84 , srv1747441848:84 , srv1754017204:84 , srv1828723766:84 , srv1847117899:84 , srv1944623968:84 , srv196941411:84 , srv1982266931:84 , srv1987346315:84 , srv1987700794:84 , srv1988621709:84 , srv201275776:84 , srv2043812747:84 , srv2044043891:84 , srv2048270674:84 , srv2050836533:84 , srv2057455602:84 , srv2071585057:84 , srv2072615809:84 , srv2077215308:84 , srv2078833647:84 , srv2099446760:84 , srv2102331011:84 , srv2125730081:84 , srv2132069614:84 , srv217177008:84 , srv23497990:84 , srv237936638:84 , srv264980675:84 , srv266318339:84 , srv285292385:84 , srv321341357:84 , srv333506052:84 , srv34336856:84 , srv352398689:84 , srv387121156:84 , srv442521820:84 , srv457554037:84 , srv492458177:84 , srv516087609:84 , srv523453542:84 , srv527333183:84 , srv53644762:84 , srv556466126:84 , srv565245604:84 , srv57297190:84 , srv573033975:84 , srv596439779:84 , srv606284568:84 , srv639529662:84 , srv701471335:84 , srv719134195:84 , srv741094717:84 , srv742008543:84 , srv757517360:84 , srv76135527:84 , srv770833502:84 , srv774524636:84 , srv834017298:84 , srv870277990:84 , srv94088295:84 , srv954800913:84 , srv971932544:84 , srv1552869374:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-13 04:55:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1615218848=29, srv1747441848=38, srv1641891280=31, srv954800913=98, srv870277990=96, srv1040665481=2, srv1141201468=10, srv196941411=43, srv266318339=66, srv1518293270=22, srv774524636=94, srv1987700794=46, srv1210896528=11, srv352398689=71, srv2102331011=59, srv1283284329=13, srv1466785643=18, srv1982266931=44, srv2043812747=49, srv2132069614=61, srv2048270674=51, srv1078270408=6, srv23497990=63, srv1105087040=9, srv701471335=87, srv523453542=77, srv285292385=67, srv34336856=70, srv457554037=74, srv492458177=75, srv1706331876=35, srv1539874760=23, srv1655361934=32, srv1582224904=26, srv565245604=81, srv1005453905=0, srv2050836533=52, srv1754017204=39, srv333506052=69, srv556466126=80, srv321341357=68, srv741094717=89, srv1944623968=42, srv387121156=72, srv2125730081=60, srv1552869374=24, srv1497487666=19, srv1499692376=20, srv1988621709=47, srv1847117899=41, srv94088295=97, srv1027198773=1, srv1047279989=4, srv2057455602=53, srv1580228773=25, srv1316934376=15, srv1041806281=3, srv217177008=62, srv1586673351=28, srv1515643962=21, srv109295006=7, srv770833502=93, srv1301031800=14, srv834017298=95, srv1709094589=36, srv2077215308=56, srv201275776=48, srv442521820=73, srv53644762=79, srv1339442215=16, srv971932544=99, srv1987346315=45, srv1405552958=17, srv1738903751=37, srv264980675=65, srv1584747719=27, srv1828723766=40, srv742008543=90, srv527333183=78, srv719134195=88, srv516087609=76, srv606284568=85, srv1099517722=8, srv2044043891=50, srv1658975934=33, srv1066671861=5, srv1617770611=30, srv639529662=86, srv237936638=64, srv1249508875=12, srv2072615809=55, srv76135527=92, srv2071585057=54, srv57297190=82, srv757517360=91, srv1683265793=34, srv2078833647=57, srv573033975=83, srv2099446760=58, srv596439779=84} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:12,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:12,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-13 04:55:12,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-13 04:55:12,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-13 04:55:12,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-13 04:55:12,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-13 04:55:12,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-13 04:55:12,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-13 04:55:12,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-13 04:55:12,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-13 04:55:12,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-13 04:55:12,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-13 04:55:12,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-13 04:55:12,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-13 04:55:13,027 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:13,027 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-13 04:55:13,027 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-13 04:55:13,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 652 ms to try 5000 different iterations.  Found a solution that moves 4678 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1789792458255589. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04060123037198708, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053568505077623764, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5197777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04060123037198708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:13,437 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1210896528:81 , srv1754017204:81 , srv2071585057:81 , srv556466126:81 , srv757517360:81 , srv217177008:82 , srv770833502:82 , srv971932544:82 , srv1141201468:83 , srv1249508875:83 , srv1515643962:83 , srv1580228773:83 , srv2050836533:83 , srv2099446760:83 , srv2132069614:83 , srv285292385:83 , srv333506052:83 , srv34336856:83 , srv352398689:83 , srv442521820:83 , srv834017298:83 , srv1078270408:84 , srv1105087040:84 , srv1301031800:84 , srv1518293270:84 , srv1747441848:84 , srv2057455602:84 , srv2102331011:84 , srv565245604:84 , srv94088295:84 , srv1027198773:85 , srv109295006:85 , srv1283284329:85 , srv1582224904:85 , srv1617770611:85 , srv1944623968:85 , srv1987700794:85 , srv2048270674:85 , srv2078833647:85 , srv264980675:85 , srv492458177:85 , srv573033975:85 , srv774524636:85 , srv1005453905:86 , srv1040665481:86 , srv1466785643:86 , srv1641891280:86 , srv1706331876:86 , srv1828723766:86 , srv1987346315:86 , srv1988621709:86 , srv201275776:86 , srv2043812747:86 , srv237936638:86 , srv321341357:86 , srv387121156:86 , srv516087609:86 , srv57297190:86 , srv954800913:86 , srv1066671861:87 , srv1405552958:87 , srv1497487666:87 , srv1539874760:87 , srv1847117899:87 , srv2125730081:87 , srv457554037:87 , srv53644762:87 , srv701471335:87 , srv742008543:87 , srv76135527:87 , srv870277990:87 , srv1041806281:88 , srv1047279989:88 , srv1499692376:88 , srv1658975934:88 , srv1982266931:88 , srv266318339:88 , srv741094717:88 , srv1316934376:89 , srv1584747719:89 , srv1655361934:89 , srv2044043891:89 , srv23497990:89 , srv523453542:89 , srv606284568:89 , srv1339442215:90 , srv2077215308:90 , srv527333183:90 , srv1099517722:91 , srv1615218848:91 , srv1738903751:91 , srv196941411:91 , srv2072615809:91 , srv1709094589:93 , srv596439779:93 , srv719134195:93 , srv639529662:94 , srv1586673351:98 , srv1683265793:104 , srv1552869374:450 }
2023-11-13 04:55:13,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:13,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1615218848=29, srv1747441848=38, srv1641891280=31, srv954800913=98, srv870277990=96, srv1040665481=2, srv1141201468=10, srv196941411=43, srv266318339=66, srv1518293270=22, srv774524636=94, srv1987700794=46, srv1210896528=11, srv352398689=71, srv2102331011=59, srv1283284329=13, srv1466785643=18, srv1982266931=44, srv2043812747=49, srv2132069614=61, srv2048270674=51, srv1078270408=6, srv23497990=63, srv1105087040=9, srv701471335=87, srv523453542=77, srv285292385=67, srv34336856=70, srv457554037=74, srv492458177=75, srv1706331876=35, srv1539874760=23, srv1655361934=32, srv1582224904=26, srv565245604=81, srv1005453905=0, srv2050836533=52, srv1754017204=39, srv333506052=69, srv556466126=80, srv321341357=68, srv741094717=89, srv1944623968=42, srv387121156=72, srv2125730081=60, srv1552869374=24, srv1497487666=19, srv1499692376=20, srv1988621709=47, srv1847117899=41, srv94088295=97, srv1027198773=1, srv1047279989=4, srv2057455602=53, srv1580228773=25, srv1316934376=15, srv1041806281=3, srv217177008=62, srv1586673351=28, srv1515643962=21, srv109295006=7, srv770833502=93, srv1301031800=14, srv834017298=95, srv1709094589=36, srv2077215308=56, srv201275776=48, srv442521820=73, srv53644762=79, srv1339442215=16, srv971932544=99, srv1987346315=45, srv1405552958=17, srv1738903751=37, srv264980675=65, srv1584747719=27, srv1828723766=40, srv742008543=90, srv527333183=78, srv719134195=88, srv516087609=76, srv606284568=85, srv1099517722=8, srv2044043891=50, srv1658975934=33, srv1066671861=5, srv1617770611=30, srv639529662=86, srv237936638=64, srv1249508875=12, srv2072615809=55, srv76135527=92, srv2071585057=54, srv57297190=82, srv757517360=91, srv1683265793=34, srv2078833647=57, srv573033975=83, srv2099446760=58, srv596439779=84} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:13,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-13 04:55:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-13 04:55:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-13 04:55:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-13 04:55:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-13 04:55:13,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-13 04:55:13,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-13 04:55:13,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-13 04:55:13,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-13 04:55:13,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-13 04:55:13,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-13 04:55:13,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-13 04:55:13,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-13 04:55:13,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-13 04:55:13,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-13 04:55:13,680 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04060123037198708, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053568505077623764, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04060123037198708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:13,681 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-13 04:55:13,681 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17894648976944968, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04060123037198708, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053568505077623764, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04060123037198708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-13 04:55:13,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 418 ms to try 5000 different iterations.  Found a solution that moves 2679 regions; Going from a computed imbalance of 0.17894648976944968 to a new imbalance of 0.013949425899041351. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022302324766406808); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0325566070089108, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2976666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022302324766406808); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:13,942 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1683265793:69 , srv1586673351:76 , srv639529662:77 , srv596439779:78 , srv719134195:79 , srv1709094589:80 , srv2077215308:80 , srv1584747719:81 , srv1615218848:81 , srv2072615809:81 , srv1099517722:82 , srv1405552958:82 , srv1497487666:82 , srv1499692376:82 , srv1738903751:82 , srv23497990:82 , srv1041806281:83 , srv1658975934:83 , srv1847117899:83 , srv1982266931:83 , srv2125730081:83 , srv523453542:83 , srv606284568:83 , srv1005453905:84 , srv1339442215:84 , srv1466785643:84 , srv1655361934:84 , srv1828723766:84 , srv196941411:84 , srv1988621709:84 , srv201275776:84 , srv2044043891:84 , srv527333183:84 , srv53644762:84 , srv742008543:84 , srv76135527:84 , srv870277990:84 , srv1040665481:85 , srv1047279989:85 , srv1944623968:85 , srv264980675:85 , srv516087609:85 , srv1066671861:86 , srv1105087040:86 , srv1301031800:86 , srv1316934376:86 , srv1641891280:86 , srv1987346315:86 , srv2048270674:86 , srv2050836533:86 , srv2057455602:86 , srv266318339:86 , srv701471335:86 , srv741094717:86 , srv954800913:86 , srv1078270408:87 , srv1518293270:87 , srv1539874760:87 , srv1617770611:87 , srv1706331876:87 , srv2043812747:87 , srv2078833647:87 , srv2099446760:87 , srv237936638:87 , srv321341357:87 , srv387121156:87 , srv457554037:87 , srv565245604:87 , srv774524636:87 , srv94088295:87 , srv1027198773:88 , srv1283284329:88 , srv1580228773:88 , srv1582224904:88 , srv2102331011:88 , srv285292385:88 , srv492458177:88 , srv573033975:88 , srv971932544:88 , srv1210896528:89 , srv1515643962:89 , srv1747441848:89 , srv1754017204:89 , srv217177008:89 , srv770833502:89 , srv109295006:90 , srv1249508875:90 , srv2071585057:90 , srv333506052:90 , srv352398689:90 , srv57297190:90 , srv2132069614:91 , srv34336856:91 , srv757517360:91 , srv834017298:91 , srv1141201468:92 , srv442521820:92 , srv556466126:92 , srv1987700794:93 , srv1552869374:522 }
2023-11-13 04:55:13,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:13,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1615218848=29, srv1747441848=38, srv1641891280=31, srv954800913=98, srv870277990=96, srv1040665481=2, srv1141201468=10, srv196941411=43, srv266318339=66, srv1518293270=22, srv774524636=94, srv1987700794=46, srv1210896528=11, srv352398689=71, srv2102331011=59, srv1283284329=13, srv1466785643=18, srv1982266931=44, srv2043812747=49, srv2132069614=61, srv2048270674=51, srv1078270408=6, srv23497990=63, srv1105087040=9, srv701471335=87, srv523453542=77, srv285292385=67, srv34336856=70, srv457554037=74, srv492458177=75, srv1706331876=35, srv1539874760=23, srv1655361934=32, srv1582224904=26, srv565245604=81, srv1005453905=0, srv2050836533=52, srv1754017204=39, srv333506052=69, srv556466126=80, srv321341357=68, srv741094717=89, srv1944623968=42, srv387121156=72, srv2125730081=60, srv1552869374=24, srv1497487666=19, srv1499692376=20, srv1988621709=47, srv1847117899=41, srv94088295=97, srv1027198773=1, srv1047279989=4, srv2057455602=53, srv1580228773=25, srv1316934376=15, srv1041806281=3, srv217177008=62, srv1586673351=28, srv1515643962=21, srv109295006=7, srv770833502=93, srv1301031800=14, srv834017298=95, srv1709094589=36, srv2077215308=56, srv201275776=48, srv442521820=73, srv53644762=79, srv1339442215=16, srv971932544=99, srv1987346315=45, srv1405552958=17, srv1738903751=37, srv264980675=65, srv1584747719=27, srv1828723766=40, srv742008543=90, srv527333183=78, srv719134195=88, srv516087609=76, srv606284568=85, srv1099517722=8, srv2044043891=50, srv1658975934=33, srv1066671861=5, srv1617770611=30, srv639529662=86, srv237936638=64, srv1249508875=12, srv2072615809=55, srv76135527=92, srv2071585057=54, srv57297190=82, srv757517360=91, srv1683265793=34, srv2078833647=57, srv573033975=83, srv2099446760=58, srv596439779=84} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:13,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:13,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-13 04:55:13,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-13 04:55:13,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-13 04:55:13,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-13 04:55:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-13 04:55:13,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-13 04:55:14,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022302324766406808); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0325566070089108, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022302324766406808); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:14,134 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-13 04:55:14,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013930667140102358, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022302324766406808); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0325566070089108, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022302324766406808); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-13 04:55:14,487 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 501 ms to try 5000 different iterations.  Found a solution that moves 1051 regions; Going from a computed imbalance of 0.013930667140102358 to a new imbalance of 7.338671757565544E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005552187531265666); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007122465682345129); MoveCostFunction : (multiplier=7.0, imbalance=0.11677777777777777, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005552187531265666); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:14,488 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1987700794:80 , srv57297190:81 , srv109295006:82 , srv34336856:82 , srv1047279989:83 , srv1141201468:83 , srv1339442215:83 , srv196941411:83 , srv2132069614:83 , srv266318339:83 , srv442521820:83 , srv457554037:83 , srv834017298:83 , srv1099517722:84 , srv1249508875:84 , srv1283284329:84 , srv1316934376:84 , srv1539874760:84 , srv1582224904:84 , srv1586673351:84 , srv1706331876:84 , srv1709094589:84 , srv321341357:84 , srv387121156:84 , srv527333183:84 , srv556466126:84 , srv573033975:84 , srv701471335:84 , srv741094717:84 , srv1027198773:85 , srv1066671861:85 , srv1515643962:85 , srv1615218848:85 , srv1655361934:85 , srv1683265793:85 , srv1738903751:85 , srv1747441848:85 , srv1987346315:85 , srv2043812747:85 , srv2044043891:85 , srv2072615809:85 , srv2102331011:85 , srv237936638:85 , srv492458177:85 , srv523453542:85 , srv606284568:85 , srv774524636:85 , srv954800913:85 , srv1040665481:86 , srv1041806281:86 , srv1518293270:86 , srv1580228773:86 , srv1641891280:86 , srv1982266931:86 , srv2048270674:86 , srv2071585057:86 , srv2078833647:86 , srv217177008:86 , srv23497990:86 , srv333506052:86 , srv352398689:86 , srv516087609:86 , srv53644762:86 , srv719134195:86 , srv742008543:86 , srv757517360:86 , srv76135527:86 , srv1005453905:87 , srv1078270408:87 , srv1210896528:87 , srv1301031800:87 , srv1466785643:87 , srv1617770611:87 , srv1658975934:87 , srv1828723766:87 , srv1944623968:87 , srv1988621709:87 , srv201275776:87 , srv2057455602:87 , srv2077215308:87 , srv2125730081:87 , srv285292385:87 , srv565245604:87 , srv770833502:87 , srv870277990:87 , srv94088295:87 , srv1405552958:88 , srv1499692376:88 , srv1584747719:88 , srv1754017204:88 , srv1847117899:88 , srv2050836533:88 , srv2099446760:88 , srv264980675:88 , srv596439779:88 , srv971932544:88 , srv1105087040:89 , srv1497487666:89 , srv639529662:89 , srv1552869374:535 }
2023-11-13 04:55:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1615218848=29, srv1747441848=38, srv1641891280=31, srv954800913=98, srv870277990=96, srv1040665481=2, srv1141201468=10, srv196941411=43, srv266318339=66, srv1518293270=22, srv774524636=94, srv1987700794=46, srv1210896528=11, srv352398689=71, srv2102331011=59, srv1283284329=13, srv1466785643=18, srv1982266931=44, srv2043812747=49, srv2132069614=61, srv2048270674=51, srv1078270408=6, srv23497990=63, srv1105087040=9, srv701471335=87, srv523453542=77, srv285292385=67, srv34336856=70, srv457554037=74, srv492458177=75, srv1706331876=35, srv1539874760=23, srv1655361934=32, srv1582224904=26, srv565245604=81, srv1005453905=0, srv2050836533=52, srv1754017204=39, srv333506052=69, srv556466126=80, srv321341357=68, srv741094717=89, srv1944623968=42, srv387121156=72, srv2125730081=60, srv1552869374=24, srv1497487666=19, srv1499692376=20, srv1988621709=47, srv1847117899=41, srv94088295=97, srv1027198773=1, srv1047279989=4, srv2057455602=53, srv1580228773=25, srv1316934376=15, srv1041806281=3, srv217177008=62, srv1586673351=28, srv1515643962=21, srv109295006=7, srv770833502=93, srv1301031800=14, srv834017298=95, srv1709094589=36, srv2077215308=56, srv201275776=48, srv442521820=73, srv53644762=79, srv1339442215=16, srv971932544=99, srv1987346315=45, srv1405552958=17, srv1738903751=37, srv264980675=65, srv1584747719=27, srv1828723766=40, srv742008543=90, srv527333183=78, srv719134195=88, srv516087609=76, srv606284568=85, srv1099517722=8, srv2044043891=50, srv1658975934=33, srv1066671861=5, srv1617770611=30, srv639529662=86, srv237936638=64, srv1249508875=12, srv2072615809=55, srv76135527=92, srv2071585057=54, srv57297190=82, srv757517360=91, srv1683265793=34, srv2078833647=57, srv573033975=83, srv2099446760=58, srv596439779=84} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-13 04:55:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-13 04:55:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-13 04:55:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-13 04:55:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-13 04:55:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-13 04:55:14,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-13 04:55:14,617 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005552187531265666); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007122465682345129); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005552187531265666); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:14,617 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-13 04:55:14,617 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.265079164639518E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005552187531265666); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007122465682345129); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005552187531265666); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-13 04:55:14,874 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 350 ms to try 5000 different iterations.  Found a solution that moves 248 regions; Going from a computed imbalance of 7.265079164639518E-4 to a new imbalance of 2.715234493299685E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.027555555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:14,875 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv352398689:82 , srv596439779:82 , srv639529662:82 , srv1105087040:83 , srv1316934376:83 , srv1617770611:83 , srv333506052:83 , srv1027198773:84 , srv1066671861:84 , srv1078270408:84 , srv1141201468:84 , srv1497487666:84 , srv1499692376:84 , srv1539874760:84 , srv1586673351:84 , srv1641891280:84 , srv1655361934:84 , srv1658975934:84 , srv1683265793:84 , srv1709094589:84 , srv1747441848:84 , srv1847117899:84 , srv196941411:84 , srv1987700794:84 , srv2043812747:84 , srv2044043891:84 , srv2077215308:84 , srv2078833647:84 , srv2099446760:84 , srv2125730081:84 , srv237936638:84 , srv264980675:84 , srv285292385:84 , srv321341357:84 , srv387121156:84 , srv442521820:84 , srv492458177:84 , srv523453542:84 , srv565245604:84 , srv719134195:84 , srv757517360:84 , srv770833502:84 , srv870277990:84 , srv94088295:84 , srv971932544:84 , srv1005453905:85 , srv1040665481:85 , srv1041806281:85 , srv109295006:85 , srv1099517722:85 , srv1210896528:85 , srv1249508875:85 , srv1283284329:85 , srv1301031800:85 , srv1339442215:85 , srv1466785643:85 , srv1515643962:85 , srv1518293270:85 , srv1580228773:85 , srv1582224904:85 , srv1584747719:85 , srv1615218848:85 , srv1706331876:85 , srv1738903751:85 , srv1754017204:85 , srv1828723766:85 , srv1944623968:85 , srv1982266931:85 , srv1987346315:85 , srv1988621709:85 , srv201275776:85 , srv2048270674:85 , srv2050836533:85 , srv2057455602:85 , srv2071585057:85 , srv2072615809:85 , srv2132069614:85 , srv23497990:85 , srv266318339:85 , srv457554037:85 , srv516087609:85 , srv527333183:85 , srv53644762:85 , srv556466126:85 , srv57297190:85 , srv573033975:85 , srv606284568:85 , srv701471335:85 , srv741094717:85 , srv742008543:85 , srv76135527:85 , srv774524636:85 , srv834017298:85 , srv954800913:85 , srv1047279989:86 , srv1405552958:86 , srv2102331011:86 , srv217177008:86 , srv34336856:86 , srv1552869374:635 }
2023-11-13 04:55:14,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:14,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1615218848=29, srv1747441848=38, srv1641891280=31, srv954800913=98, srv870277990=96, srv1040665481=2, srv1141201468=10, srv196941411=43, srv266318339=66, srv1518293270=22, srv774524636=94, srv1987700794=46, srv1210896528=11, srv352398689=71, srv2102331011=59, srv1283284329=13, srv1466785643=18, srv1982266931=44, srv2043812747=49, srv2132069614=61, srv2048270674=51, srv1078270408=6, srv23497990=63, srv1105087040=9, srv701471335=87, srv523453542=77, srv285292385=67, srv34336856=70, srv457554037=74, srv492458177=75, srv1706331876=35, srv1539874760=23, srv1655361934=32, srv1582224904=26, srv565245604=81, srv1005453905=0, srv2050836533=52, srv1754017204=39, srv333506052=69, srv556466126=80, srv321341357=68, srv741094717=89, srv1944623968=42, srv387121156=72, srv2125730081=60, srv1552869374=24, srv1497487666=19, srv1499692376=20, srv1988621709=47, srv1847117899=41, srv94088295=97, srv1027198773=1, srv1047279989=4, srv2057455602=53, srv1580228773=25, srv1316934376=15, srv1041806281=3, srv217177008=62, srv1586673351=28, srv1515643962=21, srv109295006=7, srv770833502=93, srv1301031800=14, srv834017298=95, srv1709094589=36, srv2077215308=56, srv201275776=48, srv442521820=73, srv53644762=79, srv1339442215=16, srv971932544=99, srv1987346315=45, srv1405552958=17, srv1738903751=37, srv264980675=65, srv1584747719=27, srv1828723766=40, srv742008543=90, srv527333183=78, srv719134195=88, srv516087609=76, srv606284568=85, srv1099517722=8, srv2044043891=50, srv1658975934=33, srv1066671861=5, srv1617770611=30, srv639529662=86, srv237936638=64, srv1249508875=12, srv2072615809=55, srv76135527=92, srv2071585057=54, srv57297190=82, srv757517360=91, srv1683265793=34, srv2078833647=57, srv573033975=83, srv2099446760=58, srv596439779=84} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-13 04:55:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-13 04:55:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-13 04:55:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-13 04:55:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-13 04:55:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-13 04:55:15,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:15,005 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-13 04:55:15,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5415811817330336E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-13 04:55:15,244 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 2.5415811817330336E-5 to a new imbalance of 6.912120645670642E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:15,244 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1405552958:83 , srv1584747719:83 , srv1738903751:83 , srv1754017204:83 , srv2102331011:83 , srv217177008:83 , srv527333183:83 , srv741094717:83 , srv1005453905:84 , srv1027198773:84 , srv1040665481:84 , srv1041806281:84 , srv1047279989:84 , srv1066671861:84 , srv1078270408:84 , srv109295006:84 , srv1099517722:84 , srv1105087040:84 , srv1141201468:84 , srv1210896528:84 , srv1249508875:84 , srv1283284329:84 , srv1301031800:84 , srv1316934376:84 , srv1339442215:84 , srv1466785643:84 , srv1497487666:84 , srv1499692376:84 , srv1515643962:84 , srv1518293270:84 , srv1539874760:84 , srv1580228773:84 , srv1582224904:84 , srv1586673351:84 , srv1615218848:84 , srv1617770611:84 , srv1641891280:84 , srv1655361934:84 , srv1658975934:84 , srv1683265793:84 , srv1706331876:84 , srv1747441848:84 , srv1828723766:84 , srv1847117899:84 , srv1944623968:84 , srv196941411:84 , srv1982266931:84 , srv1987346315:84 , srv1987700794:84 , srv1988621709:84 , srv201275776:84 , srv2043812747:84 , srv2044043891:84 , srv2048270674:84 , srv2050836533:84 , srv2057455602:84 , srv2071585057:84 , srv2072615809:84 , srv2078833647:84 , srv2099446760:84 , srv2132069614:84 , srv23497990:84 , srv237936638:84 , srv264980675:84 , srv266318339:84 , srv285292385:84 , srv333506052:84 , srv34336856:84 , srv442521820:84 , srv457554037:84 , srv492458177:84 , srv516087609:84 , srv53644762:84 , srv556466126:84 , srv565245604:84 , srv57297190:84 , srv573033975:84 , srv606284568:84 , srv639529662:84 , srv701471335:84 , srv719134195:84 , srv742008543:84 , srv757517360:84 , srv76135527:84 , srv770833502:84 , srv774524636:84 , srv834017298:84 , srv870277990:84 , srv94088295:84 , srv954800913:84 , srv971932544:84 , srv1709094589:85 , srv2077215308:85 , srv2125730081:85 , srv321341357:85 , srv352398689:85 , srv387121156:85 , srv523453542:85 , srv596439779:85 , srv1552869374:684 }
2023-11-13 04:55:15,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:15,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1615218848=29, srv1747441848=38, srv1641891280=31, srv954800913=98, srv870277990=96, srv1040665481=2, srv1141201468=10, srv196941411=43, srv266318339=66, srv1518293270=22, srv774524636=94, srv1987700794=46, srv1210896528=11, srv352398689=71, srv2102331011=59, srv1283284329=13, srv1466785643=18, srv1982266931=44, srv2043812747=49, srv2132069614=61, srv2048270674=51, srv1078270408=6, srv23497990=63, srv1105087040=9, srv701471335=87, srv523453542=77, srv285292385=67, srv34336856=70, srv457554037=74, srv492458177=75, srv1706331876=35, srv1539874760=23, srv1655361934=32, srv1582224904=26, srv565245604=81, srv1005453905=0, srv2050836533=52, srv1754017204=39, srv333506052=69, srv556466126=80, srv321341357=68, srv741094717=89, srv1944623968=42, srv387121156=72, srv2125730081=60, srv1552869374=24, srv1497487666=19, srv1499692376=20, srv1988621709=47, srv1847117899=41, srv94088295=97, srv1027198773=1, srv1047279989=4, srv2057455602=53, srv1580228773=25, srv1316934376=15, srv1041806281=3, srv217177008=62, srv1586673351=28, srv1515643962=21, srv109295006=7, srv770833502=93, srv1301031800=14, srv834017298=95, srv1709094589=36, srv2077215308=56, srv201275776=48, srv442521820=73, srv53644762=79, srv1339442215=16, srv971932544=99, srv1987346315=45, srv1405552958=17, srv1738903751=37, srv264980675=65, srv1584747719=27, srv1828723766=40, srv742008543=90, srv527333183=78, srv719134195=88, srv516087609=76, srv606284568=85, srv1099517722=8, srv2044043891=50, srv1658975934=33, srv1066671861=5, srv1617770611=30, srv639529662=86, srv237936638=64, srv1249508875=12, srv2072615809=55, srv76135527=92, srv2071585057=54, srv57297190=82, srv757517360=91, srv1683265793=34, srv2078833647=57, srv573033975=83, srv2099446760=58, srv596439779=84} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:15,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:15,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-13 04:55:15,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-13 04:55:15,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-13 04:55:15,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-13 04:55:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-13 04:55:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-13 04:55:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-13 04:55:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-13 04:55:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-13 04:55:15,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-13 04:55:15,378 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:15,378 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1405552958:83 , srv1584747719:83 , srv1738903751:83 , srv1754017204:83 , srv2102331011:83 , srv217177008:83 , srv527333183:83 , srv741094717:83 , srv1005453905:84 , srv1027198773:84 , srv1040665481:84 , srv1041806281:84 , srv1047279989:84 , srv1066671861:84 , srv1078270408:84 , srv109295006:84 , srv1099517722:84 , srv1105087040:84 , srv1141201468:84 , srv1210896528:84 , srv1249508875:84 , srv1283284329:84 , srv1301031800:84 , srv1316934376:84 , srv1339442215:84 , srv1466785643:84 , srv1497487666:84 , srv1499692376:84 , srv1515643962:84 , srv1518293270:84 , srv1539874760:84 , srv1580228773:84 , srv1582224904:84 , srv1586673351:84 , srv1615218848:84 , srv1617770611:84 , srv1641891280:84 , srv1655361934:84 , srv1658975934:84 , srv1683265793:84 , srv1706331876:84 , srv1747441848:84 , srv1828723766:84 , srv1847117899:84 , srv1944623968:84 , srv196941411:84 , srv1982266931:84 , srv1987346315:84 , srv1987700794:84 , srv1988621709:84 , srv201275776:84 , srv2043812747:84 , srv2044043891:84 , srv2048270674:84 , srv2050836533:84 , srv2057455602:84 , srv2071585057:84 , srv2072615809:84 , srv2078833647:84 , srv2099446760:84 , srv2132069614:84 , srv23497990:84 , srv237936638:84 , srv264980675:84 , srv266318339:84 , srv285292385:84 , srv333506052:84 , srv34336856:84 , srv442521820:84 , srv457554037:84 , srv492458177:84 , srv516087609:84 , srv53644762:84 , srv556466126:84 , srv565245604:84 , srv57297190:84 , srv573033975:84 , srv606284568:84 , srv639529662:84 , srv701471335:84 , srv719134195:84 , srv742008543:84 , srv757517360:84 , srv76135527:84 , srv770833502:84 , srv774524636:84 , srv834017298:84 , srv870277990:84 , srv94088295:84 , srv954800913:84 , srv971932544:84 , srv1709094589:85 , srv2077215308:85 , srv2125730081:85 , srv321341357:85 , srv352398689:85 , srv387121156:85 , srv523453542:85 , srv596439779:85 , srv1552869374:684 }
2023-11-13 04:55:15,412 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 129), ProcessCount=167 (was 167), AvailableMemoryMB=2861 (was 3397)
2023-11-13 04:55:15,419 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=167, AvailableMemoryMB=2861
2023-11-13 04:55:15,419 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-13 04:55:15,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-13 04:55:15,428 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014968264:84 , srv1056921370:84 , srv1132378198:84 , srv1265197195:84 , srv133388057:84 , srv1383291957:84 , srv1426048370:84 , srv1451092212:84 , srv1541377821:84 , srv1560315863:84 , srv1570718516:84 , srv1623329853:84 , srv1681061311:84 , srv1714653262:84 , srv1715402618:84 , srv1759484710:84 , srv1783925644:84 , srv191623404:84 , srv201497920:84 , srv264470487:84 , srv285740722:84 , srv358919781:84 , srv363570492:84 , srv606938776:84 , srv816894679:84 , srv881498563:84 , srv882043456:84 , srv889390963:84 , srv91099656:84 , srv1694339889:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-13 04:55:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:55:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1694339889=13, srv91099656=29, srv358919781=22, srv816894679=25, srv1715402618=15, srv1759484710=16, srv1451092212=7, srv1560315863=9, srv1541377821=8, srv363570492=23, srv191623404=18, srv1383291957=5, srv881498563=26, srv1056921370=1, srv201497920=19, srv1623329853=11, srv264470487=20, srv1265197195=3, srv285740722=21, srv882043456=27, srv1714653262=14, srv133388057=4, srv1783925644=17, srv889390963=28, srv1014968264=0, srv1426048370=6, srv1681061311=12, srv1132378198=2, srv606938776=24, srv1570718516=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:55:15,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:55:15,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-13 04:55:15,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0992693571251964, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:55:15,458 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912505837767138, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0992693571251964, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-13 04:57:15,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5577444 different iterations.  Found a solution that moves 1866 regions; Going from a computed imbalance of 0.9912505837767138 to a new imbalance of 4.3553370884861656E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6911111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:57:15,452 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1014968264:90 , srv1056921370:90 , srv1132378198:90 , srv1265197195:90 , srv133388057:90 , srv1383291957:90 , srv1426048370:90 , srv1451092212:90 , srv1541377821:90 , srv1560315863:90 , srv1570718516:90 , srv1623329853:90 , srv1681061311:90 , srv1694339889:90 , srv1714653262:90 , srv1715402618:90 , srv1759484710:90 , srv1783925644:90 , srv191623404:90 , srv201497920:90 , srv264470487:90 , srv285740722:90 , srv358919781:90 , srv363570492:90 , srv606938776:90 , srv816894679:90 , srv881498563:90 , srv882043456:90 , srv889390963:90 , srv91099656:90 }
2023-11-13 04:57:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-13 04:57:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1694339889=13, srv91099656=29, srv358919781=22, srv816894679=25, srv1715402618=15, srv1759484710=16, srv1451092212=7, srv1560315863=9, srv1541377821=8, srv363570492=23, srv191623404=18, srv1383291957=5, srv881498563=26, srv1056921370=1, srv201497920=19, srv1623329853=11, srv264470487=20, srv1265197195=3, srv285740722=21, srv882043456=27, srv1714653262=14, srv133388057=4, srv1783925644=17, srv889390963=28, srv1014968264=0, srv1426048370=6, srv1681061311=12, srv1132378198=2, srv606938776=24, srv1570718516=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-13 04:57:15,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-13 04:57:15,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-13 04:57:15,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-13 04:57:15,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-13 04:57:15,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-13 04:57:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-13 04:57:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-13 04:57:15,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-13 04:57:15,472 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1014968264:90 , srv1056921370:90 , srv1132378198:90 , srv1265197195:90 , srv133388057:90 , srv1383291957:90 , srv1426048370:90 , srv1451092212:90 , srv1541377821:90 , srv1560315863:90 , srv1570718516:90 , srv1623329853:90 , srv1681061311:90 , srv1694339889:90 , srv1714653262:90 , srv1715402618:90 , srv1759484710:90 , srv1783925644:90 , srv191623404:90 , srv201497920:90 , srv264470487:90 , srv285740722:90 , srv358919781:90 , srv363570492:90 , srv606938776:90 , srv816894679:90 , srv881498563:90 , srv882043456:90 , srv889390963:90 , srv91099656:90 }
2023-11-13 04:57:15,484 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 129) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3079 (was 2861) - AvailableMemoryMB LEAK? -