2024-02-07 01:53:12,350 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-07 01:53:12,669 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-07 01:53:12,783 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-07 01:53:12,850 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-07 01:53:12,858 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-07 01:53:12,877 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=3831
2024-02-07 01:53:12,879 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-07 01:53:12,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-07 01:53:13,011 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1035867580:84 , srv1073191057:84 , srv1086505095:84 , srv1086683510:84 , srv110130933:84 , srv1104984461:84 , srv1134371755:84 , srv1157623623:84 , srv1172103442:84 , srv1186641712:84 , srv118733500:84 , srv1205769762:84 , srv1216237246:84 , srv1231644704:84 , srv1264476268:84 , srv1288963762:84 , srv1328523736:84 , srv1338735361:84 , srv1371461539:84 , srv1399761730:84 , srv1437653187:84 , srv1446670557:84 , srv1455803783:84 , srv1518664547:84 , srv1531268705:84 , srv1535767435:84 , srv1565562296:84 , srv160878065:84 , srv1622313863:84 , srv1647427539:84 , srv1650609593:84 , srv1658567759:84 , srv166359354:84 , srv1669685158:84 , srv168551880:84 , srv1692720556:84 , srv1693653851:84 , srv170378644:84 , srv1741633522:84 , srv1773390832:84 , srv1805087364:84 , srv1862970963:84 , srv186783343:84 , srv1877805285:84 , srv1888896104:84 , srv1898169815:84 , srv1902107203:84 , srv1964549228:84 , srv197301884:84 , srv2015315644:84 , srv2026655556:84 , srv2036525031:84 , srv2037979288:84 , srv2038855808:84 , srv2086883628:84 , srv2097015302:84 , srv2102068982:84 , srv2108273416:84 , srv2118827:84 , srv2127310480:84 , srv219410089:84 , srv224507922:84 , srv236179178:84 , srv24212668:84 , srv250211600:84 , srv273782714:84 , srv289789991:84 , srv311739671:84 , srv322659108:84 , srv335108728:84 , srv335357064:84 , srv359943101:84 , srv36490653:84 , srv384572046:84 , srv398904323:84 , srv403994438:84 , srv409767757:84 , srv417849234:84 , srv460873092:84 , srv537854904:84 , srv562320537:84 , srv597102683:84 , srv614720628:84 , srv626016833:84 , srv62779469:84 , srv698019807:84 , srv801748313:84 , srv810953307:84 , srv846519388:84 , srv852197689:84 , srv867343687:84 , srv909673675:84 , srv941365544:84 , srv944066568:84 , srv969681530:84 , srv973746941:84 , srv974960417:84 , srv983503499:84 , srv984504550:84 , srv1049241841:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-07 01:53:13,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1073191057=2, srv359943101=72, srv335357064=71, srv597102683=82, srv1437653187=21, srv1172103442=9, srv197301884=49, srv1888896104=45, srv973746941=96, srv1669685158=34, srv110130933=5, srv1877805285=44, srv36490653=73, srv562320537=81, srv1565562296=27, srv403994438=76, srv335108728=70, srv1805087364=41, srv1650609593=31, srv1186641712=10, srv1531268705=25, srv398904323=75, srv983503499=98, srv974960417=97, srv969681530=95, srv1658567759=32, srv2127310480=60, srv941365544=93, srv2102068982=57, srv1647427539=30, srv384572046=74, srv224507922=62, srv909673675=92, srv2108273416=58, srv614720628=83, srv236179178=63, srv846519388=89, srv944066568=94, srv2097015302=56, srv1231644704=14, srv118733500=11, srv1622313863=29, srv160878065=28, srv2026655556=51, srv810953307=88, srv1964549228=48, srv1157623623=8, srv322659108=69, srv417849234=78, srv1741633522=39, srv409767757=77, srv801748313=87, srv1518664547=24, srv1535767435=26, srv2037979288=53, srv289789991=67, srv852197689=90, srv273782714=66, srv1086505095=3, srv1773390832=40, srv1902107203=47, srv1216237246=13, srv24212668=64, srv626016833=84, srv186783343=43, srv2036525031=52, srv1328523736=17, srv460873092=79, srv1399761730=20, srv1455803783=23, srv168551880=35, srv1338735361=18, srv166359354=33, srv2086883628=55, srv698019807=86, srv537854904=80, srv1205769762=12, srv1049241841=1, srv867343687=91, srv1104984461=6, srv1288963762=16, srv2038855808=54, srv250211600=65, srv170378644=38, srv1692720556=36, srv62779469=85, srv311739671=68, srv1035867580=0, srv2118827=59, srv1446670557=22, srv1134371755=7, srv1371461539=19, srv1264476268=15, srv984504550=99, srv1086683510=4, srv2015315644=50, srv1693653851=37, srv1862970963=42, srv1898169815=46, srv219410089=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:13,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:13,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:13,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:13,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:13,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:13,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:13,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:13,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:13,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:13,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:13,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:13,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:13,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:13,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:13,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:13,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:13,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:13,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 01:53:13,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 01:53:13,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 01:53:13,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 01:53:13,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 01:53:13,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 01:53:13,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 01:53:13,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 01:53:13,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 01:53:13,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 01:53:13,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 01:53:13,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 01:53:13,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 01:53:13,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 01:53:13,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 01:53:13,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 01:53:13,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 01:53:13,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 01:53:13,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 01:53:13,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 01:53:13,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 01:53:13,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 01:53:13,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 01:53:13,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 01:53:13,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 01:53:13,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 01:53:13,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 01:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 01:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 01:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 01:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 01:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 01:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 01:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 01:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 01:53:13,573 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:13,574 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 01:53:13,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 01:53:14,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1128 ms to try 5000 different iterations.  Found a solution that moves 4731 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17847237792663756. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03950119216639422, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05539370362952576, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5256666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03950119216639422, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:14,315 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086683510:80 , srv1035867580:82 , srv1658567759:82 , srv2108273416:82 , srv1518664547:83 , srv1531268705:83 , srv186783343:83 , srv2015315644:83 , srv983503499:83 , srv1157623623:84 , srv1172103442:84 , srv1650609593:84 , srv1862970963:84 , srv1964549228:84 , srv2038855808:84 , srv2102068982:84 , srv2118827:84 , srv219410089:84 , srv409767757:84 , srv1205769762:85 , srv1264476268:85 , srv1371461539:85 , srv1399761730:85 , srv1437653187:85 , srv1446670557:85 , srv1622313863:85 , srv1773390832:85 , srv1877805285:85 , srv1902107203:85 , srv2036525031:85 , srv2086883628:85 , srv2097015302:85 , srv224507922:85 , srv537854904:85 , srv62779469:85 , srv973746941:85 , srv974960417:85 , srv1104984461:86 , srv1134371755:86 , srv1186641712:86 , srv1288963762:86 , srv1338735361:86 , srv160878065:86 , srv1647427539:86 , srv1692720556:86 , srv1741633522:86 , srv236179178:86 , srv311739671:86 , srv335108728:86 , srv36490653:86 , srv417849234:86 , srv460873092:86 , srv597102683:86 , srv614720628:86 , srv801748313:86 , srv867343687:86 , srv941365544:86 , srv1073191057:87 , srv110130933:87 , srv1565562296:87 , srv1669685158:87 , srv168551880:87 , srv1693653851:87 , srv1888896104:87 , srv2127310480:87 , srv250211600:87 , srv273782714:87 , srv289789991:87 , srv562320537:87 , srv626016833:87 , srv846519388:87 , srv1231644704:88 , srv1455803783:88 , srv166359354:88 , srv1898169815:88 , srv197301884:88 , srv2037979288:88 , srv24212668:88 , srv335357064:88 , srv384572046:88 , srv403994438:88 , srv810953307:88 , srv852197689:88 , srv909673675:88 , srv359943101:89 , srv698019807:89 , srv984504550:89 , srv1086505095:90 , srv170378644:90 , srv2026655556:90 , srv322659108:90 , srv969681530:90 , srv1328523736:91 , srv398904323:91 , srv1535767435:92 , srv1805087364:92 , srv944066568:92 , srv1216237246:95 , srv118733500:96 , srv1049241841:441 }
2024-02-07 01:53:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1073191057=2, srv359943101=72, srv335357064=71, srv597102683=82, srv1437653187=21, srv1172103442=9, srv197301884=49, srv1888896104=45, srv973746941=96, srv1669685158=34, srv110130933=5, srv1877805285=44, srv36490653=73, srv562320537=81, srv1565562296=27, srv403994438=76, srv335108728=70, srv1805087364=41, srv1650609593=31, srv1186641712=10, srv1531268705=25, srv398904323=75, srv983503499=98, srv974960417=97, srv969681530=95, srv1658567759=32, srv2127310480=60, srv941365544=93, srv2102068982=57, srv1647427539=30, srv384572046=74, srv224507922=62, srv909673675=92, srv2108273416=58, srv614720628=83, srv236179178=63, srv846519388=89, srv944066568=94, srv2097015302=56, srv1231644704=14, srv118733500=11, srv1622313863=29, srv160878065=28, srv2026655556=51, srv810953307=88, srv1964549228=48, srv1157623623=8, srv322659108=69, srv417849234=78, srv1741633522=39, srv409767757=77, srv801748313=87, srv1518664547=24, srv1535767435=26, srv2037979288=53, srv289789991=67, srv852197689=90, srv273782714=66, srv1086505095=3, srv1773390832=40, srv1902107203=47, srv1216237246=13, srv24212668=64, srv626016833=84, srv186783343=43, srv2036525031=52, srv1328523736=17, srv460873092=79, srv1399761730=20, srv1455803783=23, srv168551880=35, srv1338735361=18, srv166359354=33, srv2086883628=55, srv698019807=86, srv537854904=80, srv1205769762=12, srv1049241841=1, srv867343687=91, srv1104984461=6, srv1288963762=16, srv2038855808=54, srv250211600=65, srv170378644=38, srv1692720556=36, srv62779469=85, srv311739671=68, srv1035867580=0, srv2118827=59, srv1446670557=22, srv1134371755=7, srv1371461539=19, srv1264476268=15, srv984504550=99, srv1086683510=4, srv2015315644=50, srv1693653851=37, srv1862970963=42, srv1898169815=46, srv219410089=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 01:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 01:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 01:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 01:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 01:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 01:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 01:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 01:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 01:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 01:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 01:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 01:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 01:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 01:53:14,593 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03950119216639422, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05539370362952576, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03950119216639422, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:14,594 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 01:53:14,594 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17843925075659633, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03950119216639422, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05539370362952576, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03950119216639422, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 01:53:14,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 542 ms to try 5000 different iterations.  Found a solution that moves 2610 regions; Going from a computed imbalance of 0.17843925075659633 to a new imbalance of 0.015476036637402983. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020815761388544286); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03339724512654672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020815761388544286); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:14,938 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv118733500:78 , srv1216237246:79 , srv1805087364:79 , srv1535767435:80 , srv2026655556:81 , srv398904323:81 , srv944066568:81 , srv1328523736:82 , srv197301884:82 , srv1455803783:83 , srv168551880:83 , srv2127310480:83 , srv846519388:83 , srv852197689:83 , srv969681530:83 , srv984504550:83 , srv1086505095:84 , srv1104984461:84 , srv1231644704:84 , srv170378644:84 , srv1741633522:84 , srv2037979288:84 , srv24212668:84 , srv273782714:84 , srv322659108:84 , srv335357064:84 , srv384572046:84 , srv1134371755:85 , srv1205769762:85 , srv1565562296:85 , srv1622313863:85 , srv1647427539:85 , srv1669685158:85 , srv1692720556:85 , srv1693653851:85 , srv1898169815:85 , srv2097015302:85 , srv250211600:85 , srv36490653:85 , srv403994438:85 , srv614720628:85 , srv698019807:85 , srv810953307:85 , srv1073191057:86 , srv110130933:86 , srv1172103442:86 , srv1186641712:86 , srv1264476268:86 , srv1338735361:86 , srv1437653187:86 , srv160878065:86 , srv1877805285:86 , srv1888896104:86 , srv2036525031:86 , srv224507922:86 , srv236179178:86 , srv289789991:86 , srv311739671:86 , srv359943101:86 , srv460873092:86 , srv537854904:86 , srv562320537:86 , srv626016833:86 , srv867343687:86 , srv941365544:86 , srv1288963762:87 , srv1371461539:87 , srv1518664547:87 , srv166359354:87 , srv1964549228:87 , srv2102068982:87 , srv2118827:87 , srv219410089:87 , srv597102683:87 , srv801748313:87 , srv909673675:87 , srv973746941:87 , srv1773390832:88 , srv1902107203:88 , srv2086883628:88 , srv2108273416:88 , srv335108728:88 , srv409767757:88 , srv417849234:88 , srv1035867580:89 , srv1157623623:89 , srv1399761730:89 , srv1446670557:89 , srv1650609593:89 , srv1658567759:89 , srv1862970963:89 , srv186783343:89 , srv62779469:89 , srv974960417:89 , srv1531268705:90 , srv2015315644:90 , srv2038855808:90 , srv1086683510:91 , srv983503499:91 , srv1049241841:518 }
2024-02-07 01:53:14,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:14,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1073191057=2, srv359943101=72, srv335357064=71, srv597102683=82, srv1437653187=21, srv1172103442=9, srv197301884=49, srv1888896104=45, srv973746941=96, srv1669685158=34, srv110130933=5, srv1877805285=44, srv36490653=73, srv562320537=81, srv1565562296=27, srv403994438=76, srv335108728=70, srv1805087364=41, srv1650609593=31, srv1186641712=10, srv1531268705=25, srv398904323=75, srv983503499=98, srv974960417=97, srv969681530=95, srv1658567759=32, srv2127310480=60, srv941365544=93, srv2102068982=57, srv1647427539=30, srv384572046=74, srv224507922=62, srv909673675=92, srv2108273416=58, srv614720628=83, srv236179178=63, srv846519388=89, srv944066568=94, srv2097015302=56, srv1231644704=14, srv118733500=11, srv1622313863=29, srv160878065=28, srv2026655556=51, srv810953307=88, srv1964549228=48, srv1157623623=8, srv322659108=69, srv417849234=78, srv1741633522=39, srv409767757=77, srv801748313=87, srv1518664547=24, srv1535767435=26, srv2037979288=53, srv289789991=67, srv852197689=90, srv273782714=66, srv1086505095=3, srv1773390832=40, srv1902107203=47, srv1216237246=13, srv24212668=64, srv626016833=84, srv186783343=43, srv2036525031=52, srv1328523736=17, srv460873092=79, srv1399761730=20, srv1455803783=23, srv168551880=35, srv1338735361=18, srv166359354=33, srv2086883628=55, srv698019807=86, srv537854904=80, srv1205769762=12, srv1049241841=1, srv867343687=91, srv1104984461=6, srv1288963762=16, srv2038855808=54, srv250211600=65, srv170378644=38, srv1692720556=36, srv62779469=85, srv311739671=68, srv1035867580=0, srv2118827=59, srv1446670557=22, srv1134371755=7, srv1371461539=19, srv1264476268=15, srv984504550=99, srv1086683510=4, srv2015315644=50, srv1693653851=37, srv1862970963=42, srv1898169815=46, srv219410089=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:14,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:14,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:14,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:14,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 01:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 01:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 01:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 01:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 01:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 01:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 01:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 01:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 01:53:15,137 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020815761388544286); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03339724512654672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020815761388544286); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:15,137 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 01:53:15,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015457761026790525, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020815761388544286); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03339724512654672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020815761388544286); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 01:53:15,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 420 ms to try 5000 different iterations.  Found a solution that moves 1021 regions; Going from a computed imbalance of 0.015457761026790525 to a new imbalance of 5.358609368974464E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005868832712402046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.11344444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005868832712402046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:15,425 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv166359354:82 , srv909673675:82 , srv118733500:83 , srv1216237246:83 , srv1446670557:83 , srv170378644:83 , srv335108728:83 , srv359943101:83 , srv62779469:83 , srv974960417:83 , srv1073191057:84 , srv1086505095:84 , srv110130933:84 , srv1328523736:84 , srv1399761730:84 , srv1862970963:84 , srv2038855808:84 , srv250211600:84 , srv289789991:84 , srv322659108:84 , srv417849234:84 , srv562320537:84 , srv597102683:84 , srv626016833:84 , srv944066568:84 , srv983503499:84 , srv1157623623:85 , srv1186641712:85 , srv1288963762:85 , srv1338735361:85 , srv1371461539:85 , srv1531268705:85 , srv1565562296:85 , srv160878065:85 , srv1650609593:85 , srv1773390832:85 , srv186783343:85 , srv1888896104:85 , srv1898169815:85 , srv1902107203:85 , srv2015315644:85 , srv2037979288:85 , srv236179178:85 , srv335357064:85 , srv384572046:85 , srv403994438:85 , srv460873092:85 , srv698019807:85 , srv801748313:85 , srv810953307:85 , srv969681530:85 , srv973746941:85 , srv984504550:85 , srv1035867580:86 , srv1134371755:86 , srv1231644704:86 , srv1264476268:86 , srv1437653187:86 , srv1535767435:86 , srv1669685158:86 , srv1693653851:86 , srv1805087364:86 , srv1964549228:86 , srv2026655556:86 , srv2036525031:86 , srv2086883628:86 , srv2102068982:86 , srv2118827:86 , srv219410089:86 , srv24212668:86 , srv273782714:86 , srv311739671:86 , srv36490653:86 , srv398904323:86 , srv409767757:86 , srv867343687:86 , srv941365544:86 , srv1086683510:87 , srv1172103442:87 , srv1205769762:87 , srv1455803783:87 , srv1518664547:87 , srv1647427539:87 , srv1658567759:87 , srv1692720556:87 , srv1741633522:87 , srv1877805285:87 , srv197301884:87 , srv2108273416:87 , srv2127310480:87 , srv224507922:87 , srv537854904:87 , srv614720628:87 , srv846519388:87 , srv852197689:87 , srv1104984461:88 , srv1622313863:88 , srv168551880:88 , srv2097015302:88 , srv1049241841:551 }
2024-02-07 01:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1073191057=2, srv359943101=72, srv335357064=71, srv597102683=82, srv1437653187=21, srv1172103442=9, srv197301884=49, srv1888896104=45, srv973746941=96, srv1669685158=34, srv110130933=5, srv1877805285=44, srv36490653=73, srv562320537=81, srv1565562296=27, srv403994438=76, srv335108728=70, srv1805087364=41, srv1650609593=31, srv1186641712=10, srv1531268705=25, srv398904323=75, srv983503499=98, srv974960417=97, srv969681530=95, srv1658567759=32, srv2127310480=60, srv941365544=93, srv2102068982=57, srv1647427539=30, srv384572046=74, srv224507922=62, srv909673675=92, srv2108273416=58, srv614720628=83, srv236179178=63, srv846519388=89, srv944066568=94, srv2097015302=56, srv1231644704=14, srv118733500=11, srv1622313863=29, srv160878065=28, srv2026655556=51, srv810953307=88, srv1964549228=48, srv1157623623=8, srv322659108=69, srv417849234=78, srv1741633522=39, srv409767757=77, srv801748313=87, srv1518664547=24, srv1535767435=26, srv2037979288=53, srv289789991=67, srv852197689=90, srv273782714=66, srv1086505095=3, srv1773390832=40, srv1902107203=47, srv1216237246=13, srv24212668=64, srv626016833=84, srv186783343=43, srv2036525031=52, srv1328523736=17, srv460873092=79, srv1399761730=20, srv1455803783=23, srv168551880=35, srv1338735361=18, srv166359354=33, srv2086883628=55, srv698019807=86, srv537854904=80, srv1205769762=12, srv1049241841=1, srv867343687=91, srv1104984461=6, srv1288963762=16, srv2038855808=54, srv250211600=65, srv170378644=38, srv1692720556=36, srv62779469=85, srv311739671=68, srv1035867580=0, srv2118827=59, srv1446670557=22, srv1134371755=7, srv1371461539=19, srv1264476268=15, srv984504550=99, srv1086683510=4, srv2015315644=50, srv1693653851=37, srv1862970963=42, srv1898169815=46, srv219410089=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:15,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:15,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:15,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:15,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:15,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 01:53:15,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 01:53:15,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 01:53:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 01:53:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 01:53:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 01:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 01:53:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 01:53:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 01:53:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 01:53:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 01:53:15,564 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005868832712402046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005868832712402046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:15,564 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 01:53:15,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.28711742094642E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005868832712402046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005868832712402046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 01:53:15,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 458 ms to try 5000 different iterations.  Found a solution that moves 200 regions; Going from a computed imbalance of 5.28711742094642E-4 to a new imbalance of 2.531409266187718E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.022222222222222223); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:15,924 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2086883628:83 , srv698019807:83 , srv1086505095:84 , srv1086683510:84 , srv1104984461:84 , srv1157623623:84 , srv1172103442:84 , srv1231644704:84 , srv1288963762:84 , srv1399761730:84 , srv1455803783:84 , srv1531268705:84 , srv1622313863:84 , srv1647427539:84 , srv1658567759:84 , srv1669685158:84 , srv168551880:84 , srv1692720556:84 , srv1693653851:84 , srv1773390832:84 , srv1805087364:84 , srv1877805285:84 , srv1888896104:84 , srv1898169815:84 , srv1902107203:84 , srv2015315644:84 , srv2038855808:84 , srv2097015302:84 , srv224507922:84 , srv24212668:84 , srv311739671:84 , srv322659108:84 , srv359943101:84 , srv398904323:84 , srv403994438:84 , srv409767757:84 , srv417849234:84 , srv537854904:84 , srv614720628:84 , srv62779469:84 , srv801748313:84 , srv810953307:84 , srv852197689:84 , srv867343687:84 , srv969681530:84 , srv983503499:84 , srv1035867580:85 , srv1073191057:85 , srv110130933:85 , srv1134371755:85 , srv1186641712:85 , srv118733500:85 , srv1205769762:85 , srv1216237246:85 , srv1264476268:85 , srv1328523736:85 , srv1338735361:85 , srv1371461539:85 , srv1437653187:85 , srv1446670557:85 , srv1518664547:85 , srv1535767435:85 , srv1565562296:85 , srv160878065:85 , srv1650609593:85 , srv166359354:85 , srv170378644:85 , srv1741633522:85 , srv1862970963:85 , srv186783343:85 , srv1964549228:85 , srv197301884:85 , srv2026655556:85 , srv2036525031:85 , srv2037979288:85 , srv2102068982:85 , srv2118827:85 , srv2127310480:85 , srv219410089:85 , srv236179178:85 , srv250211600:85 , srv273782714:85 , srv289789991:85 , srv335108728:85 , srv335357064:85 , srv36490653:85 , srv384572046:85 , srv460873092:85 , srv562320537:85 , srv597102683:85 , srv626016833:85 , srv846519388:85 , srv909673675:85 , srv941365544:85 , srv944066568:85 , srv973746941:85 , srv974960417:85 , srv984504550:85 , srv2108273416:86 , srv1049241841:632 }
2024-02-07 01:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1073191057=2, srv359943101=72, srv335357064=71, srv597102683=82, srv1437653187=21, srv1172103442=9, srv197301884=49, srv1888896104=45, srv973746941=96, srv1669685158=34, srv110130933=5, srv1877805285=44, srv36490653=73, srv562320537=81, srv1565562296=27, srv403994438=76, srv335108728=70, srv1805087364=41, srv1650609593=31, srv1186641712=10, srv1531268705=25, srv398904323=75, srv983503499=98, srv974960417=97, srv969681530=95, srv1658567759=32, srv2127310480=60, srv941365544=93, srv2102068982=57, srv1647427539=30, srv384572046=74, srv224507922=62, srv909673675=92, srv2108273416=58, srv614720628=83, srv236179178=63, srv846519388=89, srv944066568=94, srv2097015302=56, srv1231644704=14, srv118733500=11, srv1622313863=29, srv160878065=28, srv2026655556=51, srv810953307=88, srv1964549228=48, srv1157623623=8, srv322659108=69, srv417849234=78, srv1741633522=39, srv409767757=77, srv801748313=87, srv1518664547=24, srv1535767435=26, srv2037979288=53, srv289789991=67, srv852197689=90, srv273782714=66, srv1086505095=3, srv1773390832=40, srv1902107203=47, srv1216237246=13, srv24212668=64, srv626016833=84, srv186783343=43, srv2036525031=52, srv1328523736=17, srv460873092=79, srv1399761730=20, srv1455803783=23, srv168551880=35, srv1338735361=18, srv166359354=33, srv2086883628=55, srv698019807=86, srv537854904=80, srv1205769762=12, srv1049241841=1, srv867343687=91, srv1104984461=6, srv1288963762=16, srv2038855808=54, srv250211600=65, srv170378644=38, srv1692720556=36, srv62779469=85, srv311739671=68, srv1035867580=0, srv2118827=59, srv1446670557=22, srv1134371755=7, srv1371461539=19, srv1264476268=15, srv984504550=99, srv1086683510=4, srv2015315644=50, srv1693653851=37, srv1862970963=42, srv1898169815=46, srv219410089=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:15,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 01:53:15,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 01:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 01:53:15,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 01:53:15,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 01:53:16,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:16,045 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 01:53:16,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.3913662729888057E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 01:53:16,291 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 16 regions; Going from a computed imbalance of 2.3913662729888057E-5 to a new imbalance of 6.510020066828829E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0017777777777777779); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:16,292 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1535767435:83 , srv1650609593:83 , srv2108273416:83 , srv941365544:83 , srv1035867580:84 , srv1073191057:84 , srv1086505095:84 , srv1086683510:84 , srv110130933:84 , srv1104984461:84 , srv1134371755:84 , srv1157623623:84 , srv1186641712:84 , srv118733500:84 , srv1205769762:84 , srv1216237246:84 , srv1231644704:84 , srv1264476268:84 , srv1288963762:84 , srv1328523736:84 , srv1338735361:84 , srv1371461539:84 , srv1399761730:84 , srv1437653187:84 , srv1446670557:84 , srv1455803783:84 , srv1518664547:84 , srv1531268705:84 , srv1565562296:84 , srv160878065:84 , srv1622313863:84 , srv1647427539:84 , srv1658567759:84 , srv166359354:84 , srv1669685158:84 , srv168551880:84 , srv1692720556:84 , srv1693653851:84 , srv170378644:84 , srv1741633522:84 , srv1773390832:84 , srv1862970963:84 , srv186783343:84 , srv1877805285:84 , srv1888896104:84 , srv1898169815:84 , srv1902107203:84 , srv1964549228:84 , srv197301884:84 , srv2015315644:84 , srv2026655556:84 , srv2036525031:84 , srv2037979288:84 , srv2038855808:84 , srv2086883628:84 , srv2097015302:84 , srv2102068982:84 , srv2118827:84 , srv2127310480:84 , srv219410089:84 , srv224507922:84 , srv236179178:84 , srv24212668:84 , srv273782714:84 , srv289789991:84 , srv311739671:84 , srv322659108:84 , srv335108728:84 , srv335357064:84 , srv359943101:84 , srv36490653:84 , srv384572046:84 , srv398904323:84 , srv403994438:84 , srv409767757:84 , srv417849234:84 , srv460873092:84 , srv537854904:84 , srv562320537:84 , srv597102683:84 , srv614720628:84 , srv626016833:84 , srv698019807:84 , srv801748313:84 , srv810953307:84 , srv846519388:84 , srv852197689:84 , srv867343687:84 , srv909673675:84 , srv944066568:84 , srv969681530:84 , srv973746941:84 , srv974960417:84 , srv983503499:84 , srv984504550:84 , srv1172103442:85 , srv1805087364:85 , srv250211600:85 , srv62779469:85 , srv1049241841:684 }
2024-02-07 01:53:16,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1073191057=2, srv359943101=72, srv335357064=71, srv597102683=82, srv1437653187=21, srv1172103442=9, srv197301884=49, srv1888896104=45, srv973746941=96, srv1669685158=34, srv110130933=5, srv1877805285=44, srv36490653=73, srv562320537=81, srv1565562296=27, srv403994438=76, srv335108728=70, srv1805087364=41, srv1650609593=31, srv1186641712=10, srv1531268705=25, srv398904323=75, srv983503499=98, srv974960417=97, srv969681530=95, srv1658567759=32, srv2127310480=60, srv941365544=93, srv2102068982=57, srv1647427539=30, srv384572046=74, srv224507922=62, srv909673675=92, srv2108273416=58, srv614720628=83, srv236179178=63, srv846519388=89, srv944066568=94, srv2097015302=56, srv1231644704=14, srv118733500=11, srv1622313863=29, srv160878065=28, srv2026655556=51, srv810953307=88, srv1964549228=48, srv1157623623=8, srv322659108=69, srv417849234=78, srv1741633522=39, srv409767757=77, srv801748313=87, srv1518664547=24, srv1535767435=26, srv2037979288=53, srv289789991=67, srv852197689=90, srv273782714=66, srv1086505095=3, srv1773390832=40, srv1902107203=47, srv1216237246=13, srv24212668=64, srv626016833=84, srv186783343=43, srv2036525031=52, srv1328523736=17, srv460873092=79, srv1399761730=20, srv1455803783=23, srv168551880=35, srv1338735361=18, srv166359354=33, srv2086883628=55, srv698019807=86, srv537854904=80, srv1205769762=12, srv1049241841=1, srv867343687=91, srv1104984461=6, srv1288963762=16, srv2038855808=54, srv250211600=65, srv170378644=38, srv1692720556=36, srv62779469=85, srv311739671=68, srv1035867580=0, srv2118827=59, srv1446670557=22, srv1134371755=7, srv1371461539=19, srv1264476268=15, srv984504550=99, srv1086683510=4, srv2015315644=50, srv1693653851=37, srv1862970963=42, srv1898169815=46, srv219410089=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:16,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:16,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 01:53:16,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 01:53:16,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 01:53:16,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 01:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 01:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 01:53:16,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 01:53:16,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:16,445 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1535767435:83 , srv1650609593:83 , srv2108273416:83 , srv941365544:83 , srv1035867580:84 , srv1073191057:84 , srv1086505095:84 , srv1086683510:84 , srv110130933:84 , srv1104984461:84 , srv1134371755:84 , srv1157623623:84 , srv1186641712:84 , srv118733500:84 , srv1205769762:84 , srv1216237246:84 , srv1231644704:84 , srv1264476268:84 , srv1288963762:84 , srv1328523736:84 , srv1338735361:84 , srv1371461539:84 , srv1399761730:84 , srv1437653187:84 , srv1446670557:84 , srv1455803783:84 , srv1518664547:84 , srv1531268705:84 , srv1565562296:84 , srv160878065:84 , srv1622313863:84 , srv1647427539:84 , srv1658567759:84 , srv166359354:84 , srv1669685158:84 , srv168551880:84 , srv1692720556:84 , srv1693653851:84 , srv170378644:84 , srv1741633522:84 , srv1773390832:84 , srv1862970963:84 , srv186783343:84 , srv1877805285:84 , srv1888896104:84 , srv1898169815:84 , srv1902107203:84 , srv1964549228:84 , srv197301884:84 , srv2015315644:84 , srv2026655556:84 , srv2036525031:84 , srv2037979288:84 , srv2038855808:84 , srv2086883628:84 , srv2097015302:84 , srv2102068982:84 , srv2118827:84 , srv2127310480:84 , srv219410089:84 , srv224507922:84 , srv236179178:84 , srv24212668:84 , srv273782714:84 , srv289789991:84 , srv311739671:84 , srv322659108:84 , srv335108728:84 , srv335357064:84 , srv359943101:84 , srv36490653:84 , srv384572046:84 , srv398904323:84 , srv403994438:84 , srv409767757:84 , srv417849234:84 , srv460873092:84 , srv537854904:84 , srv562320537:84 , srv597102683:84 , srv614720628:84 , srv626016833:84 , srv698019807:84 , srv801748313:84 , srv810953307:84 , srv846519388:84 , srv852197689:84 , srv867343687:84 , srv909673675:84 , srv944066568:84 , srv969681530:84 , srv973746941:84 , srv974960417:84 , srv983503499:84 , srv984504550:84 , srv1172103442:85 , srv1805087364:85 , srv250211600:85 , srv62779469:85 , srv1049241841:684 }
2024-02-07 01:53:16,473 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 291), ProcessCount=170 (was 170), AvailableMemoryMB=2896 (was 3831)
2024-02-07 01:53:16,483 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=2895
2024-02-07 01:53:16,483 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-07 01:53:16,484 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-07 01:53:16,493 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv111538756:84 , srv12287988:84 , srv1233413758:84 , srv1292985846:84 , srv131039933:84 , srv1405028059:84 , srv1530477252:84 , srv1712309675:84 , srv1729283703:84 , srv1763559947:84 , srv1781144946:84 , srv2000716664:84 , srv2034341838:84 , srv2083594503:84 , srv2087048900:84 , srv2126025830:84 , srv315000325:84 , srv382417746:84 , srv475349321:84 , srv551023190:84 , srv58522518:84 , srv58737795:84 , srv596466803:84 , srv707022547:84 , srv715446975:84 , srv724168313:84 , srv748847895:84 , srv757719453:84 , srv92052714:84 , srv479990947:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-07 01:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405028059=5, srv2083594503=13, srv724168313=26, srv58737795=22, srv1781144946=10, srv1530477252=6, srv707022547=24, srv715446975=25, srv12287988=1, srv315000325=16, srv748847895=27, srv2000716664=11, srv382417746=17, srv475349321=18, srv2126025830=15, srv2087048900=14, srv58522518=21, srv111538756=0, srv1763559947=9, srv596466803=23, srv2034341838=12, srv551023190=20, srv131039933=4, srv479990947=19, srv1712309675=7, srv1292985846=3, srv1729283703=8, srv1233413758=2, srv757719453=28, srv92052714=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-07 01:53:16,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1166087107324332, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:53:16,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912560473504173, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1166087107324332, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-07 01:55:16,513 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6391223 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.9912560473504173 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:55:16,520 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv111538756:90 , srv12287988:90 , srv1233413758:90 , srv1292985846:90 , srv131039933:90 , srv1405028059:90 , srv1530477252:90 , srv1712309675:90 , srv1729283703:90 , srv1763559947:90 , srv1781144946:90 , srv2000716664:90 , srv2034341838:90 , srv2083594503:90 , srv2087048900:90 , srv2126025830:90 , srv315000325:90 , srv382417746:90 , srv475349321:90 , srv479990947:90 , srv551023190:90 , srv58522518:90 , srv58737795:90 , srv596466803:90 , srv707022547:90 , srv715446975:90 , srv724168313:90 , srv748847895:90 , srv757719453:90 , srv92052714:90 }
2024-02-07 01:55:16,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 01:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1405028059=5, srv2083594503=13, srv724168313=26, srv58737795=22, srv1781144946=10, srv1530477252=6, srv707022547=24, srv715446975=25, srv12287988=1, srv315000325=16, srv748847895=27, srv2000716664=11, srv382417746=17, srv475349321=18, srv2126025830=15, srv2087048900=14, srv58522518=21, srv111538756=0, srv1763559947=9, srv596466803=23, srv2034341838=12, srv551023190=20, srv131039933=4, srv479990947=19, srv1712309675=7, srv1292985846=3, srv1729283703=8, srv1233413758=2, srv757719453=28, srv92052714=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 01:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 01:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 01:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 01:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 01:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 01:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 01:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 01:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-07 01:55:16,543 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 01:55:16,543 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv111538756:90 , srv12287988:90 , srv1233413758:90 , srv1292985846:90 , srv131039933:90 , srv1405028059:90 , srv1530477252:90 , srv1712309675:90 , srv1729283703:90 , srv1763559947:90 , srv1781144946:90 , srv2000716664:90 , srv2034341838:90 , srv2083594503:90 , srv2087048900:90 , srv2126025830:90 , srv315000325:90 , srv382417746:90 , srv475349321:90 , srv479990947:90 , srv551023190:90 , srv58522518:90 , srv58737795:90 , srv596466803:90 , srv707022547:90 , srv715446975:90 , srv724168313:90 , srv748847895:90 , srv757719453:90 , srv92052714:90 }
2024-02-07 01:55:16,557 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 291), ProcessCount=170 (was 170), AvailableMemoryMB=2859 (was 2895)