2023-12-15 23:54:26,572 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-15 23:54:26,814 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-15 23:54:26,911 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-15 23:54:26,964 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-15 23:54:26,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-15 23:54:26,981 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=554, ProcessCount=172, AvailableMemoryMB=2790
2023-12-15 23:54:26,983 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-15 23:54:26,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-15 23:54:27,088 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv101521773:84 , srv104134720:84 , srv1059325277:84 , srv1070986321:84 , srv1085126418:84 , srv109848929:84 , srv1135936671:84 , srv1140694183:84 , srv1155485905:84 , srv118693783:84 , srv1199358203:84 , srv1200133934:84 , srv1236609855:84 , srv1282342880:84 , srv1284483346:84 , srv1354804613:84 , srv135668406:84 , srv1382771775:84 , srv139192926:84 , srv1426754186:84 , srv1427797328:84 , srv1450233686:84 , srv1456420569:84 , srv1494900948:84 , srv1495077471:84 , srv1500115796:84 , srv1528549127:84 , srv1539204295:84 , srv1555118051:84 , srv1592373532:84 , srv1602012600:84 , srv1672440465:84 , srv1684436135:84 , srv1706378492:84 , srv1712698631:84 , srv1724623559:84 , srv1740622090:84 , srv1764068223:84 , srv1771489735:84 , srv1787165159:84 , srv1795823777:84 , srv1800179324:84 , srv1802497519:84 , srv1809226004:84 , srv1838721162:84 , srv1839913556:84 , srv1846121847:84 , srv1886138769:84 , srv194022879:84 , srv1950115795:84 , srv1976597989:84 , srv200092523:84 , srv2009922283:84 , srv2033306637:84 , srv2071581613:84 , srv2076394021:84 , srv2080863062:84 , srv2095975595:84 , srv209617821:84 , srv2099183643:84 , srv2104688790:84 , srv211300666:84 , srv280157975:84 , srv295187275:84 , srv317875403:84 , srv329494671:84 , srv342293240:84 , srv367926133:84 , srv386738763:84 , srv435705167:84 , srv482585252:84 , srv482934861:84 , srv484953526:84 , srv499972440:84 , srv551258866:84 , srv571717689:84 , srv621431162:84 , srv651145210:84 , srv65295462:84 , srv691413326:84 , srv73057612:84 , srv73753624:84 , srv754074926:84 , srv757533014:84 , srv761407540:84 , srv785446658:84 , srv798283089:84 , srv810569694:84 , srv829811793:84 , srv845825587:84 , srv845910359:84 , srv860362758:84 , srv890003368:84 , srv895947096:84 , srv897228307:84 , srv904381580:84 , srv930057804:84 , srv938341161:84 , srv961126893:84 , srv1167884644:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-15 23:54:27,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:54:27,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427797328=21, srv1284483346=15, srv200092523=52, srv845910359=91, srv1059325277=2, srv754074926=83, srv1354804613=16, srv1494900948=24, srv367926133=68, srv1236609855=13, srv1085126418=4, srv1809226004=44, srv209617821=59, srv435705167=70, srv482934861=72, srv845825587=90, srv1684436135=33, srv1764068223=38, srv317875403=65, srv1712698631=35, srv1706378492=34, srv1839913556=46, srv1976597989=51, srv1450233686=22, srv1539204295=28, srv798283089=87, srv329494671=66, srv104134720=1, srv1456420569=23, srv1495077471=25, srv810569694=88, srv930057804=97, srv961126893=99, srv1740622090=37, srv1602012600=31, srv2071581613=55, srv621431162=77, srv1838721162=45, srv65295462=79, srv938341161=98, srv829811793=89, srv890003368=93, srv691413326=80, srv1282342880=14, srv1382771775=18, srv1200133934=12, srv1426754186=20, srv139192926=19, srv897228307=95, srv1724623559=36, srv73753624=82, srv1592373532=30, srv1070986321=3, srv482585252=71, srv551258866=75, srv1787165159=40, srv785446658=86, srv211300666=62, srv1155485905=8, srv280157975=63, srv1140694183=7, srv342293240=67, srv295187275=64, srv1199358203=11, srv2095975595=58, srv571717689=76, srv2009922283=53, srv2104688790=61, srv499972440=74, srv1771489735=39, srv73057612=81, srv757533014=84, srv1846121847=47, srv1886138769=48, srv386738763=69, srv1528549127=27, srv1950115795=50, srv118693783=10, srv761407540=85, srv904381580=96, srv101521773=0, srv1135936671=6, srv1500115796=26, srv2080863062=57, srv2033306637=54, srv1672440465=32, srv194022879=49, srv860362758=92, srv1555118051=29, srv2099183643=60, srv1167884644=9, srv135668406=17, srv484953526=73, srv1800179324=42, srv651145210=78, srv1795823777=41, srv895947096=94, srv2076394021=56, srv1802497519=43, srv109848929=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:54:27,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:54:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:54:27,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:54:27,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 23:54:27,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 23:54:27,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 23:54:27,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 23:54:27,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 23:54:27,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 23:54:27,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 23:54:27,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 23:54:27,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 23:54:27,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 23:54:27,325 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:27,325 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 23:54:27,325 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 23:54:27,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 417 ms to try 5000 different iterations.  Found a solution that moves 4704 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18141691908625107. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042684865647335576, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06117076977770027, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5226666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042684865647335576, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:27,632 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2009922283:79 , srv101521773:80 , srv1839913556:81 , srv317875403:81 , srv798283089:81 , srv1284483346:82 , srv1886138769:82 , srv1976597989:82 , srv2076394021:82 , srv367926133:82 , srv551258866:82 , srv691413326:82 , srv961126893:82 , srv1199358203:83 , srv1426754186:83 , srv1846121847:83 , srv200092523:83 , srv2095975595:83 , srv757533014:83 , srv860362758:83 , srv139192926:84 , srv1456420569:84 , srv1764068223:84 , srv1800179324:84 , srv2080863062:84 , srv571717689:84 , srv65295462:84 , srv845825587:84 , srv845910359:84 , srv895947096:84 , srv1070986321:85 , srv1236609855:85 , srv1427797328:85 , srv1592373532:85 , srv1672440465:85 , srv1802497519:85 , srv2033306637:85 , srv2071581613:85 , srv2099183643:85 , srv329494671:85 , srv386738763:85 , srv435705167:85 , srv761407540:85 , srv897228307:85 , srv1494900948:86 , srv1495077471:86 , srv1528549127:86 , srv1809226004:86 , srv209617821:86 , srv484953526:86 , srv499972440:86 , srv651145210:86 , srv754074926:86 , srv810569694:86 , srv829811793:86 , srv1085126418:87 , srv1155485905:87 , srv1200133934:87 , srv1382771775:87 , srv1539204295:87 , srv1555118051:87 , srv1706378492:87 , srv1838721162:87 , srv280157975:87 , srv482585252:87 , srv904381580:87 , srv930057804:87 , srv938341161:87 , srv1135936671:88 , srv1602012600:88 , srv1684436135:88 , srv1712698631:88 , srv1787165159:88 , srv1795823777:88 , srv211300666:88 , srv621431162:88 , srv785446658:88 , srv1059325277:89 , srv1140694183:89 , srv1354804613:89 , srv1450233686:89 , srv1724623559:89 , srv1771489735:89 , srv1950115795:89 , srv295187275:89 , srv342293240:89 , srv73057612:89 , srv73753624:89 , srv1500115796:90 , srv2104688790:90 , srv482934861:90 , srv104134720:91 , srv1282342880:91 , srv109848929:92 , srv890003368:92 , srv118693783:93 , srv194022879:94 , srv1740622090:95 , srv135668406:96 , srv1167884644:469 }
2023-12-15 23:54:27,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:54:27,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427797328=21, srv1284483346=15, srv200092523=52, srv845910359=91, srv1059325277=2, srv754074926=83, srv1354804613=16, srv1494900948=24, srv367926133=68, srv1236609855=13, srv1085126418=4, srv1809226004=44, srv209617821=59, srv435705167=70, srv482934861=72, srv845825587=90, srv1684436135=33, srv1764068223=38, srv317875403=65, srv1712698631=35, srv1706378492=34, srv1839913556=46, srv1976597989=51, srv1450233686=22, srv1539204295=28, srv798283089=87, srv329494671=66, srv104134720=1, srv1456420569=23, srv1495077471=25, srv810569694=88, srv930057804=97, srv961126893=99, srv1740622090=37, srv1602012600=31, srv2071581613=55, srv621431162=77, srv1838721162=45, srv65295462=79, srv938341161=98, srv829811793=89, srv890003368=93, srv691413326=80, srv1282342880=14, srv1382771775=18, srv1200133934=12, srv1426754186=20, srv139192926=19, srv897228307=95, srv1724623559=36, srv73753624=82, srv1592373532=30, srv1070986321=3, srv482585252=71, srv551258866=75, srv1787165159=40, srv785446658=86, srv211300666=62, srv1155485905=8, srv280157975=63, srv1140694183=7, srv342293240=67, srv295187275=64, srv1199358203=11, srv2095975595=58, srv571717689=76, srv2009922283=53, srv2104688790=61, srv499972440=74, srv1771489735=39, srv73057612=81, srv757533014=84, srv1846121847=47, srv1886138769=48, srv386738763=69, srv1528549127=27, srv1950115795=50, srv118693783=10, srv761407540=85, srv904381580=96, srv101521773=0, srv1135936671=6, srv1500115796=26, srv2080863062=57, srv2033306637=54, srv1672440465=32, srv194022879=49, srv860362758=92, srv1555118051=29, srv2099183643=60, srv1167884644=9, srv135668406=17, srv484953526=73, srv1800179324=42, srv651145210=78, srv1795823777=41, srv895947096=94, srv2076394021=56, srv1802497519=43, srv109848929=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:54:27,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:54:27,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:54:27,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:54:27,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:54:27,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:54:27,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:54:27,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:54:27,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 23:54:27,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 23:54:27,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 23:54:27,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 23:54:27,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 23:54:27,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 23:54:27,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 23:54:27,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 23:54:27,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 23:54:27,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 23:54:27,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 23:54:27,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 23:54:27,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 23:54:27,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042684865647335576, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06117076977770027, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042684865647335576, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:27,774 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 23:54:27,775 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18138398097425068, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042684865647335576, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06117076977770027, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042684865647335576, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 23:54:27,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 254 ms to try 5000 different iterations.  Found a solution that moves 2597 regions; Going from a computed imbalance of 0.18138398097425068 to a new imbalance of 0.01415734949970531. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023506120966848044); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03758716021189434, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28855555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023506120966848044); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:27,953 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv135668406:75 , srv1740622090:77 , srv118693783:78 , srv109848929:80 , srv194022879:80 , srv104134720:81 , srv1059325277:81 , srv295187275:81 , srv482934861:81 , srv73057612:81 , srv890003368:81 , srv1135936671:82 , srv1140694183:82 , srv1282342880:82 , srv1771489735:82 , srv1787165159:82 , srv211300666:82 , srv1450233686:83 , srv1602012600:83 , srv1795823777:83 , srv2104688790:83 , srv342293240:83 , srv73753624:83 , srv1354804613:84 , srv1382771775:84 , srv1495077471:84 , srv1500115796:84 , srv1539204295:84 , srv1724623559:84 , srv1809226004:84 , srv621431162:84 , srv904381580:84 , srv1200133934:85 , srv1555118051:85 , srv1672440465:85 , srv1706378492:85 , srv1802497519:85 , srv280157975:85 , srv329494671:85 , srv651145210:85 , srv860362758:85 , srv938341161:85 , srv1070986321:86 , srv1085126418:86 , srv1155485905:86 , srv1236609855:86 , srv1427797328:86 , srv1528549127:86 , srv1684436135:86 , srv1838721162:86 , srv1950115795:86 , srv2033306637:86 , srv482585252:86 , srv499972440:86 , srv754074926:86 , srv810569694:86 , srv829811793:86 , srv895947096:86 , srv930057804:86 , srv1456420569:87 , srv1494900948:87 , srv1800179324:87 , srv2071581613:87 , srv209617821:87 , srv2099183643:87 , srv484953526:87 , srv761407540:87 , srv1199358203:88 , srv1426754186:88 , srv1712698631:88 , srv1846121847:88 , srv200092523:88 , srv386738763:88 , srv435705167:88 , srv757533014:88 , srv785446658:88 , srv961126893:88 , srv139192926:89 , srv1592373532:89 , srv1886138769:89 , srv2080863062:89 , srv2095975595:89 , srv571717689:89 , srv65295462:89 , srv691413326:89 , srv845825587:89 , srv845910359:89 , srv897228307:89 , srv101521773:90 , srv1764068223:90 , srv317875403:90 , srv367926133:90 , srv551258866:90 , srv1284483346:91 , srv1839913556:91 , srv1976597989:91 , srv2076394021:91 , srv798283089:91 , srv2009922283:92 , srv1167884644:514 }
2023-12-15 23:54:27,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:54:27,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427797328=21, srv1284483346=15, srv200092523=52, srv845910359=91, srv1059325277=2, srv754074926=83, srv1354804613=16, srv1494900948=24, srv367926133=68, srv1236609855=13, srv1085126418=4, srv1809226004=44, srv209617821=59, srv435705167=70, srv482934861=72, srv845825587=90, srv1684436135=33, srv1764068223=38, srv317875403=65, srv1712698631=35, srv1706378492=34, srv1839913556=46, srv1976597989=51, srv1450233686=22, srv1539204295=28, srv798283089=87, srv329494671=66, srv104134720=1, srv1456420569=23, srv1495077471=25, srv810569694=88, srv930057804=97, srv961126893=99, srv1740622090=37, srv1602012600=31, srv2071581613=55, srv621431162=77, srv1838721162=45, srv65295462=79, srv938341161=98, srv829811793=89, srv890003368=93, srv691413326=80, srv1282342880=14, srv1382771775=18, srv1200133934=12, srv1426754186=20, srv139192926=19, srv897228307=95, srv1724623559=36, srv73753624=82, srv1592373532=30, srv1070986321=3, srv482585252=71, srv551258866=75, srv1787165159=40, srv785446658=86, srv211300666=62, srv1155485905=8, srv280157975=63, srv1140694183=7, srv342293240=67, srv295187275=64, srv1199358203=11, srv2095975595=58, srv571717689=76, srv2009922283=53, srv2104688790=61, srv499972440=74, srv1771489735=39, srv73057612=81, srv757533014=84, srv1846121847=47, srv1886138769=48, srv386738763=69, srv1528549127=27, srv1950115795=50, srv118693783=10, srv761407540=85, srv904381580=96, srv101521773=0, srv1135936671=6, srv1500115796=26, srv2080863062=57, srv2033306637=54, srv1672440465=32, srv194022879=49, srv860362758=92, srv1555118051=29, srv2099183643=60, srv1167884644=9, srv135668406=17, srv484953526=73, srv1800179324=42, srv651145210=78, srv1795823777=41, srv895947096=94, srv2076394021=56, srv1802497519=43, srv109848929=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:54:27,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:54:27,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:54:27,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 23:54:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 23:54:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 23:54:27,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 23:54:27,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 23:54:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 23:54:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 23:54:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 23:54:27,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 23:54:27,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 23:54:27,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 23:54:27,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 23:54:27,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 23:54:27,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 23:54:28,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023506120966848044); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03758716021189434, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023506120966848044); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:28,069 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 23:54:28,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014139164917038429, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023506120966848044); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03758716021189434, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023506120966848044); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 23:54:28,222 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 225 ms to try 5000 different iterations.  Found a solution that moves 975 regions; Going from a computed imbalance of 0.014139164917038429 to a new imbalance of 5.435725284270317E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007568945684203332); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011141372931414577); MoveCostFunction : (multiplier=7.0, imbalance=0.10833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007568945684203332); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:28,224 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1712698631:82 , srv785446658:82 , srv1500115796:83 , srv1592373532:83 , srv1764068223:83 , srv194022879:83 , srv1950115795:83 , srv2104688790:83 , srv1085126418:84 , srv139192926:84 , srv1528549127:84 , srv1555118051:84 , srv1684436135:84 , srv1706378492:84 , srv1724623559:84 , srv1838721162:84 , srv1976597989:84 , srv2076394021:84 , srv209617821:84 , srv386738763:84 , srv435705167:84 , srv482585252:84 , srv484953526:84 , srv499972440:84 , srv73753624:84 , srv845825587:84 , srv109848929:85 , srv1140694183:85 , srv1155485905:85 , srv1200133934:85 , srv1282342880:85 , srv1284483346:85 , srv1427797328:85 , srv1450233686:85 , srv1494900948:85 , srv1740622090:85 , srv1839913556:85 , srv1886138769:85 , srv2071581613:85 , srv2099183643:85 , srv280157975:85 , srv367926133:85 , srv571717689:85 , srv65295462:85 , srv754074926:85 , srv829811793:85 , srv845910359:85 , srv890003368:85 , srv897228307:85 , srv930057804:85 , srv101521773:86 , srv104134720:86 , srv1070986321:86 , srv1199358203:86 , srv1236609855:86 , srv1354804613:86 , srv135668406:86 , srv1382771775:86 , srv1426754186:86 , srv1771489735:86 , srv1795823777:86 , srv1800179324:86 , srv1846121847:86 , srv2009922283:86 , srv2080863062:86 , srv2095975595:86 , srv317875403:86 , srv342293240:86 , srv482934861:86 , srv551258866:86 , srv621431162:86 , srv651145210:86 , srv73057612:86 , srv757533014:86 , srv798283089:86 , srv938341161:86 , srv961126893:86 , srv1135936671:87 , srv118693783:87 , srv1456420569:87 , srv1495077471:87 , srv1539204295:87 , srv1602012600:87 , srv1787165159:87 , srv1802497519:87 , srv200092523:87 , srv2033306637:87 , srv211300666:87 , srv691413326:87 , srv761407540:87 , srv810569694:87 , srv904381580:87 , srv1059325277:88 , srv1672440465:88 , srv295187275:88 , srv329494671:88 , srv860362758:88 , srv895947096:88 , srv1809226004:89 , srv1167884644:542 }
2023-12-15 23:54:28,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:54:28,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427797328=21, srv1284483346=15, srv200092523=52, srv845910359=91, srv1059325277=2, srv754074926=83, srv1354804613=16, srv1494900948=24, srv367926133=68, srv1236609855=13, srv1085126418=4, srv1809226004=44, srv209617821=59, srv435705167=70, srv482934861=72, srv845825587=90, srv1684436135=33, srv1764068223=38, srv317875403=65, srv1712698631=35, srv1706378492=34, srv1839913556=46, srv1976597989=51, srv1450233686=22, srv1539204295=28, srv798283089=87, srv329494671=66, srv104134720=1, srv1456420569=23, srv1495077471=25, srv810569694=88, srv930057804=97, srv961126893=99, srv1740622090=37, srv1602012600=31, srv2071581613=55, srv621431162=77, srv1838721162=45, srv65295462=79, srv938341161=98, srv829811793=89, srv890003368=93, srv691413326=80, srv1282342880=14, srv1382771775=18, srv1200133934=12, srv1426754186=20, srv139192926=19, srv897228307=95, srv1724623559=36, srv73753624=82, srv1592373532=30, srv1070986321=3, srv482585252=71, srv551258866=75, srv1787165159=40, srv785446658=86, srv211300666=62, srv1155485905=8, srv280157975=63, srv1140694183=7, srv342293240=67, srv295187275=64, srv1199358203=11, srv2095975595=58, srv571717689=76, srv2009922283=53, srv2104688790=61, srv499972440=74, srv1771489735=39, srv73057612=81, srv757533014=84, srv1846121847=47, srv1886138769=48, srv386738763=69, srv1528549127=27, srv1950115795=50, srv118693783=10, srv761407540=85, srv904381580=96, srv101521773=0, srv1135936671=6, srv1500115796=26, srv2080863062=57, srv2033306637=54, srv1672440465=32, srv194022879=49, srv860362758=92, srv1555118051=29, srv2099183643=60, srv1167884644=9, srv135668406=17, srv484953526=73, srv1800179324=42, srv651145210=78, srv1795823777=41, srv895947096=94, srv2076394021=56, srv1802497519=43, srv109848929=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:54:28,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:54:28,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 23:54:28,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 23:54:28,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 23:54:28,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 23:54:28,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 23:54:28,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 23:54:28,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 23:54:28,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 23:54:28,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 23:54:28,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 23:54:28,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 23:54:28,323 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007568945684203332); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011141372931414577); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007568945684203332); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:28,323 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 23:54:28,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.367454325085848E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007568945684203332); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011141372931414577); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007568945684203332); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 23:54:28,545 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 295 ms to try 5000 different iterations.  Found a solution that moves 316 regions; Going from a computed imbalance of 5.367454325085848E-4 to a new imbalance of 1.259775403878346E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.035111111111111114, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:28,546 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1809226004:83 , srv2080863062:83 , srv761407540:83 , srv810569694:83 , srv897228307:83 , srv930057804:83 , srv104134720:84 , srv1059325277:84 , srv1155485905:84 , srv1282342880:84 , srv1354804613:84 , srv135668406:84 , srv1456420569:84 , srv1494900948:84 , srv1495077471:84 , srv1539204295:84 , srv1602012600:84 , srv1672440465:84 , srv1684436135:84 , srv1802497519:84 , srv1950115795:84 , srv200092523:84 , srv2009922283:84 , srv2033306637:84 , srv295187275:84 , srv329494671:84 , srv342293240:84 , srv551258866:84 , srv571717689:84 , srv621431162:84 , srv651145210:84 , srv65295462:84 , srv691413326:84 , srv785446658:84 , srv798283089:84 , srv845910359:84 , srv890003368:84 , srv895947096:84 , srv904381580:84 , srv938341161:84 , srv101521773:85 , srv1085126418:85 , srv109848929:85 , srv1135936671:85 , srv118693783:85 , srv1199358203:85 , srv1200133934:85 , srv1236609855:85 , srv1284483346:85 , srv1382771775:85 , srv139192926:85 , srv1426754186:85 , srv1450233686:85 , srv1555118051:85 , srv1712698631:85 , srv1724623559:85 , srv1740622090:85 , srv1764068223:85 , srv1771489735:85 , srv1787165159:85 , srv1795823777:85 , srv1800179324:85 , srv1838721162:85 , srv1839913556:85 , srv1846121847:85 , srv194022879:85 , srv2071581613:85 , srv2076394021:85 , srv2095975595:85 , srv209617821:85 , srv2099183643:85 , srv2104688790:85 , srv211300666:85 , srv280157975:85 , srv317875403:85 , srv386738763:85 , srv435705167:85 , srv482585252:85 , srv482934861:85 , srv484953526:85 , srv754074926:85 , srv757533014:85 , srv829811793:85 , srv845825587:85 , srv1070986321:86 , srv1140694183:86 , srv1427797328:86 , srv1500115796:86 , srv1528549127:86 , srv1592373532:86 , srv1706378492:86 , srv1886138769:86 , srv1976597989:86 , srv367926133:86 , srv499972440:86 , srv73057612:86 , srv73753624:86 , srv860362758:86 , srv961126893:86 , srv1167884644:616 }
2023-12-15 23:54:28,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:54:28,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427797328=21, srv1284483346=15, srv200092523=52, srv845910359=91, srv1059325277=2, srv754074926=83, srv1354804613=16, srv1494900948=24, srv367926133=68, srv1236609855=13, srv1085126418=4, srv1809226004=44, srv209617821=59, srv435705167=70, srv482934861=72, srv845825587=90, srv1684436135=33, srv1764068223=38, srv317875403=65, srv1712698631=35, srv1706378492=34, srv1839913556=46, srv1976597989=51, srv1450233686=22, srv1539204295=28, srv798283089=87, srv329494671=66, srv104134720=1, srv1456420569=23, srv1495077471=25, srv810569694=88, srv930057804=97, srv961126893=99, srv1740622090=37, srv1602012600=31, srv2071581613=55, srv621431162=77, srv1838721162=45, srv65295462=79, srv938341161=98, srv829811793=89, srv890003368=93, srv691413326=80, srv1282342880=14, srv1382771775=18, srv1200133934=12, srv1426754186=20, srv139192926=19, srv897228307=95, srv1724623559=36, srv73753624=82, srv1592373532=30, srv1070986321=3, srv482585252=71, srv551258866=75, srv1787165159=40, srv785446658=86, srv211300666=62, srv1155485905=8, srv280157975=63, srv1140694183=7, srv342293240=67, srv295187275=64, srv1199358203=11, srv2095975595=58, srv571717689=76, srv2009922283=53, srv2104688790=61, srv499972440=74, srv1771489735=39, srv73057612=81, srv757533014=84, srv1846121847=47, srv1886138769=48, srv386738763=69, srv1528549127=27, srv1950115795=50, srv118693783=10, srv761407540=85, srv904381580=96, srv101521773=0, srv1135936671=6, srv1500115796=26, srv2080863062=57, srv2033306637=54, srv1672440465=32, srv194022879=49, srv860362758=92, srv1555118051=29, srv2099183643=60, srv1167884644=9, srv135668406=17, srv484953526=73, srv1800179324=42, srv651145210=78, srv1795823777=41, srv895947096=94, srv2076394021=56, srv1802497519=43, srv109848929=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:54:28,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:54:28,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 23:54:28,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 23:54:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 23:54:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 23:54:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 23:54:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 23:54:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 23:54:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 23:54:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 23:54:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 23:54:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 23:54:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 23:54:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 23:54:28,646 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.038507474624065E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:28,646 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1809226004:83 , srv2080863062:83 , srv761407540:83 , srv810569694:83 , srv897228307:83 , srv930057804:83 , srv104134720:84 , srv1059325277:84 , srv1155485905:84 , srv1282342880:84 , srv1354804613:84 , srv135668406:84 , srv1456420569:84 , srv1494900948:84 , srv1495077471:84 , srv1539204295:84 , srv1602012600:84 , srv1672440465:84 , srv1684436135:84 , srv1802497519:84 , srv1950115795:84 , srv200092523:84 , srv2009922283:84 , srv2033306637:84 , srv295187275:84 , srv329494671:84 , srv342293240:84 , srv551258866:84 , srv571717689:84 , srv621431162:84 , srv651145210:84 , srv65295462:84 , srv691413326:84 , srv785446658:84 , srv798283089:84 , srv845910359:84 , srv890003368:84 , srv895947096:84 , srv904381580:84 , srv938341161:84 , srv101521773:85 , srv1085126418:85 , srv109848929:85 , srv1135936671:85 , srv118693783:85 , srv1199358203:85 , srv1200133934:85 , srv1236609855:85 , srv1284483346:85 , srv1382771775:85 , srv139192926:85 , srv1426754186:85 , srv1450233686:85 , srv1555118051:85 , srv1712698631:85 , srv1724623559:85 , srv1740622090:85 , srv1764068223:85 , srv1771489735:85 , srv1787165159:85 , srv1795823777:85 , srv1800179324:85 , srv1838721162:85 , srv1839913556:85 , srv1846121847:85 , srv194022879:85 , srv2071581613:85 , srv2076394021:85 , srv2095975595:85 , srv209617821:85 , srv2099183643:85 , srv2104688790:85 , srv211300666:85 , srv280157975:85 , srv317875403:85 , srv386738763:85 , srv435705167:85 , srv482585252:85 , srv482934861:85 , srv484953526:85 , srv754074926:85 , srv757533014:85 , srv829811793:85 , srv845825587:85 , srv1070986321:86 , srv1140694183:86 , srv1427797328:86 , srv1500115796:86 , srv1528549127:86 , srv1592373532:86 , srv1706378492:86 , srv1886138769:86 , srv1976597989:86 , srv367926133:86 , srv499972440:86 , srv73057612:86 , srv73753624:86 , srv860362758:86 , srv961126893:86 , srv1167884644:616 }
2023-12-15 23:54:28,667 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=554 (was 554), ProcessCount=172 (was 172), AvailableMemoryMB=2309 (was 2790)
2023-12-15 23:54:28,674 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=554, ProcessCount=172, AvailableMemoryMB=2309
2023-12-15 23:54:28,674 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-15 23:54:28,675 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-15 23:54:28,681 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv103066587:84 , srv1040498234:84 , srv1040678307:84 , srv1052475956:84 , srv1057067847:84 , srv1108789592:84 , srv1206669073:84 , srv1356918833:84 , srv1468107348:84 , srv1489008465:84 , srv1560391483:84 , srv1589145727:84 , srv1653132396:84 , srv1722330370:84 , srv1824857338:84 , srv1851113144:84 , srv1870818037:84 , srv1873533448:84 , srv1944009821:84 , srv1998082258:84 , srv2093831934:84 , srv26990415:84 , srv311250267:84 , srv342963285:84 , srv351286964:84 , srv461421505:84 , srv615605899:84 , srv659468096:84 , srv985916719:84 , srv1811261437:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-15 23:54:28,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:54:28,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1206669073=6, srv1873533448=18, srv659468096=28, srv26990415=22, srv103066587=0, srv1052475956=3, srv1468107348=8, srv1040498234=1, srv1489008465=9, srv1589145727=11, srv615605899=27, srv2093831934=21, srv985916719=29, srv1722330370=13, srv1108789592=5, srv1870818037=17, srv311250267=23, srv1560391483=10, srv1356918833=7, srv1040678307=2, srv1653132396=12, srv1824857338=15, srv1944009821=19, srv1998082258=20, srv351286964=25, srv461421505=26, srv1057067847=4, srv1851113144=16, srv342963285=24, srv1811261437=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:54:28,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:54:28,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:54:28,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:54:28,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:54:28,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:54:28,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:54:28,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:54:28,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-15 23:54:28,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1041432167939838, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:54:28,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991252119513981, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1041432167939838, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-15 23:56:28,695 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9300565 different iterations.  Found a solution that moves 1836 regions; Going from a computed imbalance of 0.991252119513981 to a new imbalance of 4.2853155918867096E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.68, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:56:28,702 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv103066587:90 , srv1040498234:90 , srv1040678307:90 , srv1052475956:90 , srv1057067847:90 , srv1108789592:90 , srv1206669073:90 , srv1356918833:90 , srv1468107348:90 , srv1489008465:90 , srv1560391483:90 , srv1589145727:90 , srv1653132396:90 , srv1722330370:90 , srv1811261437:90 , srv1824857338:90 , srv1851113144:90 , srv1870818037:90 , srv1873533448:90 , srv1944009821:90 , srv1998082258:90 , srv2093831934:90 , srv26990415:90 , srv311250267:90 , srv342963285:90 , srv351286964:90 , srv461421505:90 , srv615605899:90 , srv659468096:90 , srv985916719:90 }
2023-12-15 23:56:28,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 23:56:28,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1206669073=6, srv1873533448=18, srv659468096=28, srv26990415=22, srv103066587=0, srv1052475956=3, srv1468107348=8, srv1040498234=1, srv1489008465=9, srv1589145727=11, srv615605899=27, srv2093831934=21, srv985916719=29, srv1722330370=13, srv1108789592=5, srv1870818037=17, srv311250267=23, srv1560391483=10, srv1356918833=7, srv1040678307=2, srv1653132396=12, srv1824857338=15, srv1944009821=19, srv1998082258=20, srv351286964=25, srv461421505=26, srv1057067847=4, srv1851113144=16, srv342963285=24, srv1811261437=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 23:56:28,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 23:56:28,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 23:56:28,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 23:56:28,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 23:56:28,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 23:56:28,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 23:56:28,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 23:56:28,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 23:56:28,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 23:56:28,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 23:56:28,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-15 23:56:28,724 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 23:56:28,724 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv103066587:90 , srv1040498234:90 , srv1040678307:90 , srv1052475956:90 , srv1057067847:90 , srv1108789592:90 , srv1206669073:90 , srv1356918833:90 , srv1468107348:90 , srv1489008465:90 , srv1560391483:90 , srv1589145727:90 , srv1653132396:90 , srv1722330370:90 , srv1811261437:90 , srv1824857338:90 , srv1851113144:90 , srv1870818037:90 , srv1873533448:90 , srv1944009821:90 , srv1998082258:90 , srv2093831934:90 , srv26990415:90 , srv311250267:90 , srv342963285:90 , srv351286964:90 , srv461421505:90 , srv615605899:90 , srv659468096:90 , srv985916719:90 }
2023-12-15 23:56:28,737 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 554), ProcessCount=172 (was 172), AvailableMemoryMB=3027 (was 2309) - AvailableMemoryMB LEAK? -