2024-04-28 13:53:28,544 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-28 13:53:28,864 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-28 13:53:28,978 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-28 13:53:29,042 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-28 13:53:29,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-28 13:53:29,065 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=169, AvailableMemoryMB=3910
2024-04-28 13:53:29,067 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-28 13:53:29,068 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-28 13:53:29,222 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1028495956:84 , srv1063178941:84 , srv1072013866:84 , srv1088450021:84 , srv1116130210:84 , srv112783175:84 , srv1181419079:84 , srv1184524932:84 , srv1225154491:84 , srv1281153862:84 , srv1281278307:84 , srv1389182336:84 , srv1398158267:84 , srv1429160797:84 , srv1444761873:84 , srv1488139449:84 , srv1506403330:84 , srv1515204081:84 , srv1534271997:84 , srv1537485448:84 , srv1549515743:84 , srv1578565865:84 , srv1589363297:84 , srv1615717212:84 , srv1618000702:84 , srv1623507855:84 , srv1626437146:84 , srv1648214288:84 , srv1653863932:84 , srv1679756893:84 , srv1710784940:84 , srv1720286337:84 , srv1737661451:84 , srv1750200521:84 , srv1761843129:84 , srv1762586763:84 , srv1782493071:84 , srv1814831494:84 , srv182725403:84 , srv1841228016:84 , srv1846016706:84 , srv1856288603:84 , srv1892553800:84 , srv1908675242:84 , srv1920596701:84 , srv1936206113:84 , srv1966012667:84 , srv1974546281:84 , srv1998478790:84 , srv2025608888:84 , srv2032228005:84 , srv2032732550:84 , srv2042699856:84 , srv2059415768:84 , srv2074123017:84 , srv2085157992:84 , srv2111740166:84 , srv2125392605:84 , srv228770372:84 , srv237443660:84 , srv24333107:84 , srv250791599:84 , srv262880759:84 , srv270489704:84 , srv362023683:84 , srv368520816:84 , srv372311371:84 , srv389666607:84 , srv396618376:84 , srv399253341:84 , srv407382041:84 , srv409790680:84 , srv434129888:84 , srv439059782:84 , srv46920026:84 , srv494206917:84 , srv504712976:84 , srv507040195:84 , srv528975436:84 , srv545012876:84 , srv553853107:84 , srv56704155:84 , srv578077971:84 , srv578209292:84 , srv593765778:84 , srv664866834:84 , srv669633164:84 , srv698195269:84 , srv740197273:84 , srv779719105:84 , srv807562882:84 , srv830946504:84 , srv87965847:84 , srv882545996:84 , srv911492848:84 , srv941358219:84 , srv941583653:84 , srv945823283:84 , srv946523264:84 , srv1324117996:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-28 13:53:29,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:29,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv399253341=70, srv1750200521=34, srv698195269=88, srv1846016706=41, srv1225154491=8, srv494206917=76, srv1589363297=23, srv1072013866=2, srv779719105=90, srv396618376=69, srv1908675242=44, srv1281278307=10, srv2059415768=54, srv270489704=64, srv2042699856=53, srv578209292=84, srv1841228016=40, srv1856288603=42, srv1488139449=16, srv362023683=65, srv528975436=79, srv250791599=62, srv553853107=81, srv112783175=5, srv1429160797=14, srv504712976=77, srv2025608888=50, srv1737661451=33, srv664866834=86, srv1710784940=31, srv409790680=72, srv1088450021=3, srv389666607=68, srv1762586763=36, srv1653863932=29, srv2085157992=56, srv407382041=71, srv911492848=95, srv740197273=89, srv439059782=74, srv182725403=39, srv24333107=61, srv1281153862=9, srv1515204081=18, srv2032228005=51, srv2074123017=55, srv1974546281=48, srv941583653=97, srv882545996=94, srv807562882=91, srv578077971=83, srv1626437146=27, srv941358219=96, srv1618000702=25, srv1537485448=20, srv1324117996=11, srv1814831494=38, srv1549515743=21, srv1782493071=37, srv1720286337=32, srv1648214288=28, srv1892553800=43, srv593765778=85, srv2125392605=58, srv1679756893=30, srv1998478790=49, srv1181419079=6, srv1398158267=13, srv1534271997=19, srv2032732550=52, srv46920026=75, srv87965847=93, srv2111740166=57, srv237443660=60, srv1444761873=15, srv1761843129=35, srv434129888=73, srv545012876=80, srv1920596701=45, srv1389182336=12, srv1506403330=17, srv669633164=87, srv1116130210=4, srv1966012667=47, srv262880759=63, srv946523264=99, srv1184524932=7, srv56704155=82, srv1063178941=1, srv372311371=67, srv1615717212=24, srv1623507855=26, srv1578565865=22, srv830946504=92, srv368520816=66, srv1028495956=0, srv228770372=59, srv507040195=78, srv1936206113=46, srv945823283=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:29,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:29,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:29,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:29,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:29,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:29,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:29,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:29,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:29,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:29,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:29,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:29,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:29,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:29,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:29,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:29,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:29,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:29,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:29,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:29,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:29,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:29,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:29,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:29,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:29,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:29,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:29,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:29,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:29,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:29,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:29,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-28 13:53:29,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-28 13:53:29,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-28 13:53:29,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-28 13:53:29,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-28 13:53:29,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-28 13:53:29,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-28 13:53:29,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-28 13:53:29,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-28 13:53:29,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-28 13:53:29,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-28 13:53:29,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-28 13:53:29,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-28 13:53:29,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-28 13:53:29,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-28 13:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-28 13:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-28 13:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-28 13:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-28 13:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-28 13:53:29,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-28 13:53:29,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-28 13:53:29,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-28 13:53:29,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-28 13:53:29,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-28 13:53:29,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-28 13:53:29,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-28 13:53:29,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-28 13:53:29,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-28 13:53:29,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-28 13:53:29,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-28 13:53:29,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-28 13:53:29,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-28 13:53:29,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-28 13:53:29,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-28 13:53:29,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-28 13:53:29,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-28 13:53:29,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-28 13:53:29,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-28 13:53:29,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:29,587 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-28 13:53:29,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-28 13:53:29,988 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 594 ms to try 5000 different iterations.  Found a solution that moves 4704 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17907833162409664. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043009089368414744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05796395799535339, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5226666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.043009089368414744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17408333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:30,008 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1648214288:80 , srv2025608888:80 , srv2042699856:80 , srv507040195:80 , srv182725403:81 , srv1892553800:81 , srv2085157992:81 , srv504712976:81 , srv830946504:81 , srv1537485448:82 , srv46920026:82 , srv1429160797:83 , srv1444761873:83 , srv1515204081:83 , srv1841228016:83 , srv1908675242:83 , srv2059415768:83 , srv2125392605:83 , srv250791599:83 , srv434129888:83 , srv87965847:83 , srv1389182336:84 , srv1549515743:84 , srv1998478790:84 , srv262880759:84 , srv407382041:84 , srv56704155:84 , srv941583653:84 , srv945823283:84 , srv1088450021:85 , srv1116130210:85 , srv1506403330:85 , srv1589363297:85 , srv1720286337:85 , srv1750200521:85 , srv1856288603:85 , srv1920596701:85 , srv399253341:85 , srv494206917:85 , srv593765778:85 , srv669633164:85 , srv698195269:85 , srv882545996:85 , srv1623507855:86 , srv1710784940:86 , srv1846016706:86 , srv1936206113:86 , srv2111740166:86 , srv24333107:86 , srv270489704:86 , srv396618376:86 , srv439059782:86 , srv740197273:86 , srv946523264:86 , srv1281153862:87 , srv1398158267:87 , srv1618000702:87 , srv1814831494:87 , srv1966012667:87 , srv2032732550:87 , srv228770372:87 , srv368520816:87 , srv409790680:87 , srv664866834:87 , srv779719105:87 , srv807562882:87 , srv1028495956:88 , srv112783175:88 , srv1281278307:88 , srv1615717212:88 , srv1737661451:88 , srv1762586763:88 , srv911492848:88 , srv1181419079:89 , srv1534271997:89 , srv1578565865:89 , srv1626437146:89 , srv1679756893:89 , srv1761843129:89 , srv2032228005:89 , srv2074123017:89 , srv362023683:89 , srv528975436:89 , srv545012876:89 , srv941358219:89 , srv1063178941:90 , srv1184524932:90 , srv1225154491:90 , srv1488139449:90 , srv237443660:90 , srv389666607:90 , srv1653863932:91 , srv1974546281:91 , srv372311371:91 , srv553853107:91 , srv1072013866:92 , srv578077971:92 , srv578209292:92 , srv1782493071:93 , srv1324117996:472 }
2024-04-28 13:53:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:30,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv399253341=70, srv1750200521=34, srv698195269=88, srv1846016706=41, srv1225154491=8, srv494206917=76, srv1589363297=23, srv1072013866=2, srv779719105=90, srv396618376=69, srv1908675242=44, srv1281278307=10, srv2059415768=54, srv270489704=64, srv2042699856=53, srv578209292=84, srv1841228016=40, srv1856288603=42, srv1488139449=16, srv362023683=65, srv528975436=79, srv250791599=62, srv553853107=81, srv112783175=5, srv1429160797=14, srv504712976=77, srv2025608888=50, srv1737661451=33, srv664866834=86, srv1710784940=31, srv409790680=72, srv1088450021=3, srv389666607=68, srv1762586763=36, srv1653863932=29, srv2085157992=56, srv407382041=71, srv911492848=95, srv740197273=89, srv439059782=74, srv182725403=39, srv24333107=61, srv1281153862=9, srv1515204081=18, srv2032228005=51, srv2074123017=55, srv1974546281=48, srv941583653=97, srv882545996=94, srv807562882=91, srv578077971=83, srv1626437146=27, srv941358219=96, srv1618000702=25, srv1537485448=20, srv1324117996=11, srv1814831494=38, srv1549515743=21, srv1782493071=37, srv1720286337=32, srv1648214288=28, srv1892553800=43, srv593765778=85, srv2125392605=58, srv1679756893=30, srv1998478790=49, srv1181419079=6, srv1398158267=13, srv1534271997=19, srv2032732550=52, srv46920026=75, srv87965847=93, srv2111740166=57, srv237443660=60, srv1444761873=15, srv1761843129=35, srv434129888=73, srv545012876=80, srv1920596701=45, srv1389182336=12, srv1506403330=17, srv669633164=87, srv1116130210=4, srv1966012667=47, srv262880759=63, srv946523264=99, srv1184524932=7, srv56704155=82, srv1063178941=1, srv372311371=67, srv1615717212=24, srv1623507855=26, srv1578565865=22, srv830946504=92, srv368520816=66, srv1028495956=0, srv228770372=59, srv507040195=78, srv1936206113=46, srv945823283=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:30,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:30,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:30,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:30,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:30,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:30,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:30,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:30,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:30,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:30,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:30,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:30,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:30,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:30,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-28 13:53:30,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-28 13:53:30,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-28 13:53:30,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-28 13:53:30,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-28 13:53:30,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-28 13:53:30,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-28 13:53:30,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-28 13:53:30,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-28 13:53:30,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043009089368414744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05796395799535339, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.043009089368414744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17408333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:30,214 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-28 13:53:30,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17904539351209622, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043009089368414744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05796395799535339, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.043009089368414744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17408333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-28 13:53:30,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 422 ms to try 5000 different iterations.  Found a solution that moves 2666 regions; Going from a computed imbalance of 0.17904539351209622 to a new imbalance of 0.014343209903988699. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02396582760681156); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03494423969363984, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2962222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02396582760681156); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:30,507 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1072013866:79 , srv578077971:79 , srv1653863932:80 , srv237443660:80 , srv112783175:81 , srv1184524932:81 , srv1762586763:81 , srv1782493071:81 , srv578209292:81 , srv941358219:81 , srv1063178941:82 , srv1225154491:82 , srv1281278307:82 , srv1534271997:82 , srv1974546281:82 , srv362023683:82 , srv389666607:82 , srv1181419079:83 , srv1623507855:83 , srv1679756893:83 , srv2032228005:83 , srv545012876:83 , srv553853107:83 , srv1488139449:84 , srv1578565865:84 , srv1761843129:84 , srv1814831494:84 , srv1966012667:84 , srv2032732550:84 , srv2074123017:84 , srv372311371:84 , srv439059782:84 , srv779719105:84 , srv807562882:84 , srv1028495956:85 , srv1088450021:85 , srv1615717212:85 , srv1710784940:85 , srv1846016706:85 , srv1936206113:85 , srv228770372:85 , srv24333107:85 , srv270489704:85 , srv368520816:85 , srv396618376:85 , srv409790680:85 , srv664866834:85 , srv740197273:85 , srv1116130210:86 , srv1281153862:86 , srv1618000702:86 , srv1626437146:86 , srv1720286337:86 , srv1737661451:86 , srv1920596701:86 , srv1998478790:86 , srv262880759:86 , srv399253341:86 , srv407382041:86 , srv593765778:86 , srv669633164:86 , srv911492848:86 , srv946523264:86 , srv1589363297:87 , srv2059415768:87 , srv2111740166:87 , srv528975436:87 , srv698195269:87 , srv882545996:87 , srv1389182336:88 , srv1398158267:88 , srv1444761873:88 , srv1750200521:88 , srv1841228016:88 , srv1908675242:88 , srv2125392605:88 , srv250791599:88 , srv434129888:88 , srv46920026:88 , srv87965847:88 , srv1506403330:89 , srv1515204081:89 , srv1856288603:89 , srv941583653:89 , srv1429160797:90 , srv1537485448:90 , srv1549515743:90 , srv182725403:90 , srv1892553800:90 , srv2025608888:90 , srv2085157992:90 , srv494206917:90 , srv507040195:90 , srv56704155:90 , srv830946504:90 , srv945823283:90 , srv2042699856:91 , srv504712976:92 , srv1648214288:96 , srv1324117996:515 }
2024-04-28 13:53:30,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:30,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv399253341=70, srv1750200521=34, srv698195269=88, srv1846016706=41, srv1225154491=8, srv494206917=76, srv1589363297=23, srv1072013866=2, srv779719105=90, srv396618376=69, srv1908675242=44, srv1281278307=10, srv2059415768=54, srv270489704=64, srv2042699856=53, srv578209292=84, srv1841228016=40, srv1856288603=42, srv1488139449=16, srv362023683=65, srv528975436=79, srv250791599=62, srv553853107=81, srv112783175=5, srv1429160797=14, srv504712976=77, srv2025608888=50, srv1737661451=33, srv664866834=86, srv1710784940=31, srv409790680=72, srv1088450021=3, srv389666607=68, srv1762586763=36, srv1653863932=29, srv2085157992=56, srv407382041=71, srv911492848=95, srv740197273=89, srv439059782=74, srv182725403=39, srv24333107=61, srv1281153862=9, srv1515204081=18, srv2032228005=51, srv2074123017=55, srv1974546281=48, srv941583653=97, srv882545996=94, srv807562882=91, srv578077971=83, srv1626437146=27, srv941358219=96, srv1618000702=25, srv1537485448=20, srv1324117996=11, srv1814831494=38, srv1549515743=21, srv1782493071=37, srv1720286337=32, srv1648214288=28, srv1892553800=43, srv593765778=85, srv2125392605=58, srv1679756893=30, srv1998478790=49, srv1181419079=6, srv1398158267=13, srv1534271997=19, srv2032732550=52, srv46920026=75, srv87965847=93, srv2111740166=57, srv237443660=60, srv1444761873=15, srv1761843129=35, srv434129888=73, srv545012876=80, srv1920596701=45, srv1389182336=12, srv1506403330=17, srv669633164=87, srv1116130210=4, srv1966012667=47, srv262880759=63, srv946523264=99, srv1184524932=7, srv56704155=82, srv1063178941=1, srv372311371=67, srv1615717212=24, srv1623507855=26, srv1578565865=22, srv830946504=92, srv368520816=66, srv1028495956=0, srv228770372=59, srv507040195=78, srv1936206113=46, srv945823283=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:30,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:30,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:30,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-28 13:53:30,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-28 13:53:30,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-28 13:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-28 13:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-28 13:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-28 13:53:30,642 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02396582760681156); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03494423969363984, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02396582760681156); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:30,643 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-28 13:53:30,643 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014324542172995286, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02396582760681156); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03494423969363984, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02396582760681156); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-28 13:53:31,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 997 regions; Going from a computed imbalance of 0.014324542172995286 to a new imbalance of 8.89201471412443E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0049965694678637184); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007309112127323451); MoveCostFunction : (multiplier=7.0, imbalance=0.11077777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0049965694678637184); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:31,053 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1398158267:82 , srv1648214288:82 , srv372311371:82 , srv528975436:82 , srv1488139449:83 , srv1626437146:83 , srv1856288603:83 , srv494206917:83 , srv553853107:83 , srv911492848:83 , srv945823283:83 , srv1028495956:84 , srv1506403330:84 , srv1549515743:84 , srv1737661451:84 , srv1750200521:84 , srv1761843129:84 , srv1782493071:84 , srv2111740166:84 , srv578209292:84 , srv664866834:84 , srv1063178941:85 , srv1181419079:85 , srv1281153862:85 , srv1389182336:85 , srv1429160797:85 , srv1515204081:85 , srv1578565865:85 , srv1589363297:85 , srv1615717212:85 , srv1618000702:85 , srv2074123017:85 , srv228770372:85 , srv368520816:85 , srv504712976:85 , srv56704155:85 , srv882545996:85 , srv941583653:85 , srv946523264:85 , srv1116130210:86 , srv1184524932:86 , srv1225154491:86 , srv1444761873:86 , srv1534271997:86 , srv1537485448:86 , srv1653863932:86 , srv1679756893:86 , srv1710784940:86 , srv182725403:86 , srv1841228016:86 , srv1892553800:86 , srv1908675242:86 , srv1936206113:86 , srv1966012667:86 , srv1974546281:86 , srv2032228005:86 , srv2042699856:86 , srv2125392605:86 , srv24333107:86 , srv270489704:86 , srv389666607:86 , srv399253341:86 , srv409790680:86 , srv669633164:86 , srv698195269:86 , srv830946504:86 , srv87965847:86 , srv1088450021:87 , srv1281278307:87 , srv1720286337:87 , srv1814831494:87 , srv1846016706:87 , srv1920596701:87 , srv1998478790:87 , srv2032732550:87 , srv2085157992:87 , srv237443660:87 , srv250791599:87 , srv262880759:87 , srv362023683:87 , srv396618376:87 , srv434129888:87 , srv439059782:87 , srv46920026:87 , srv578077971:87 , srv740197273:87 , srv807562882:87 , srv941358219:87 , srv1072013866:88 , srv1623507855:88 , srv1762586763:88 , srv2059415768:88 , srv407382041:88 , srv507040195:88 , srv545012876:88 , srv593765778:88 , srv779719105:88 , srv2025608888:89 , srv112783175:90 , srv1324117996:515 }
2024-04-28 13:53:31,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:31,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv399253341=70, srv1750200521=34, srv698195269=88, srv1846016706=41, srv1225154491=8, srv494206917=76, srv1589363297=23, srv1072013866=2, srv779719105=90, srv396618376=69, srv1908675242=44, srv1281278307=10, srv2059415768=54, srv270489704=64, srv2042699856=53, srv578209292=84, srv1841228016=40, srv1856288603=42, srv1488139449=16, srv362023683=65, srv528975436=79, srv250791599=62, srv553853107=81, srv112783175=5, srv1429160797=14, srv504712976=77, srv2025608888=50, srv1737661451=33, srv664866834=86, srv1710784940=31, srv409790680=72, srv1088450021=3, srv389666607=68, srv1762586763=36, srv1653863932=29, srv2085157992=56, srv407382041=71, srv911492848=95, srv740197273=89, srv439059782=74, srv182725403=39, srv24333107=61, srv1281153862=9, srv1515204081=18, srv2032228005=51, srv2074123017=55, srv1974546281=48, srv941583653=97, srv882545996=94, srv807562882=91, srv578077971=83, srv1626437146=27, srv941358219=96, srv1618000702=25, srv1537485448=20, srv1324117996=11, srv1814831494=38, srv1549515743=21, srv1782493071=37, srv1720286337=32, srv1648214288=28, srv1892553800=43, srv593765778=85, srv2125392605=58, srv1679756893=30, srv1998478790=49, srv1181419079=6, srv1398158267=13, srv1534271997=19, srv2032732550=52, srv46920026=75, srv87965847=93, srv2111740166=57, srv237443660=60, srv1444761873=15, srv1761843129=35, srv434129888=73, srv545012876=80, srv1920596701=45, srv1389182336=12, srv1506403330=17, srv669633164=87, srv1116130210=4, srv1966012667=47, srv262880759=63, srv946523264=99, srv1184524932=7, srv56704155=82, srv1063178941=1, srv372311371=67, srv1615717212=24, srv1623507855=26, srv1578565865=22, srv830946504=92, srv368520816=66, srv1028495956=0, srv228770372=59, srv507040195=78, srv1936206113=46, srv945823283=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:31,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:31,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:31,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:31,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-28 13:53:31,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-28 13:53:31,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-28 13:53:31,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-28 13:53:31,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-28 13:53:31,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-28 13:53:31,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-28 13:53:31,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-28 13:53:31,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-28 13:53:31,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-28 13:53:31,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-28 13:53:31,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0049965694678637184); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007309112127323451); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0049965694678637184); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:31,219 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-28 13:53:31,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.822203282014772E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0049965694678637184); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007309112127323451); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0049965694678637184); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-28 13:53:31,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 378 ms to try 5000 different iterations.  Found a solution that moves 255 regions; Going from a computed imbalance of 8.822203282014772E-4 to a new imbalance of 4.1635624209144995E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.028333333333333332, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:31,484 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv545012876:82 , srv1072013866:83 , srv112783175:83 , srv2025608888:83 , srv578077971:83 , srv593765778:83 , srv779719105:83 , srv1225154491:84 , srv1281153862:84 , srv1398158267:84 , srv1429160797:84 , srv1515204081:84 , srv1537485448:84 , srv1549515743:84 , srv1578565865:84 , srv1615717212:84 , srv1618000702:84 , srv1626437146:84 , srv1648214288:84 , srv1679756893:84 , srv1720286337:84 , srv1782493071:84 , srv1814831494:84 , srv182725403:84 , srv1846016706:84 , srv1920596701:84 , srv1966012667:84 , srv1974546281:84 , srv2032228005:84 , srv2032732550:84 , srv2059415768:84 , srv2074123017:84 , srv2085157992:84 , srv250791599:84 , srv262880759:84 , srv362023683:84 , srv372311371:84 , srv389666607:84 , srv407382041:84 , srv409790680:84 , srv434129888:84 , srv494206917:84 , srv504712976:84 , srv507040195:84 , srv528975436:84 , srv56704155:84 , srv669633164:84 , srv698195269:84 , srv740197273:84 , srv807562882:84 , srv941583653:84 , srv1028495956:85 , srv1063178941:85 , srv1088450021:85 , srv1116130210:85 , srv1181419079:85 , srv1184524932:85 , srv1281278307:85 , srv1389182336:85 , srv1444761873:85 , srv1488139449:85 , srv1506403330:85 , srv1534271997:85 , srv1589363297:85 , srv1623507855:85 , srv1653863932:85 , srv1710784940:85 , srv1737661451:85 , srv1750200521:85 , srv1761843129:85 , srv1841228016:85 , srv1856288603:85 , srv1892553800:85 , srv1908675242:85 , srv1936206113:85 , srv1998478790:85 , srv2042699856:85 , srv2111740166:85 , srv2125392605:85 , srv228770372:85 , srv237443660:85 , srv270489704:85 , srv368520816:85 , srv396618376:85 , srv399253341:85 , srv46920026:85 , srv553853107:85 , srv578209292:85 , srv830946504:85 , srv87965847:85 , srv882545996:85 , srv911492848:85 , srv941358219:85 , srv945823283:85 , srv946523264:85 , srv1762586763:86 , srv24333107:86 , srv439059782:86 , srv664866834:86 , srv1324117996:640 }
2024-04-28 13:53:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:31,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv399253341=70, srv1750200521=34, srv698195269=88, srv1846016706=41, srv1225154491=8, srv494206917=76, srv1589363297=23, srv1072013866=2, srv779719105=90, srv396618376=69, srv1908675242=44, srv1281278307=10, srv2059415768=54, srv270489704=64, srv2042699856=53, srv578209292=84, srv1841228016=40, srv1856288603=42, srv1488139449=16, srv362023683=65, srv528975436=79, srv250791599=62, srv553853107=81, srv112783175=5, srv1429160797=14, srv504712976=77, srv2025608888=50, srv1737661451=33, srv664866834=86, srv1710784940=31, srv409790680=72, srv1088450021=3, srv389666607=68, srv1762586763=36, srv1653863932=29, srv2085157992=56, srv407382041=71, srv911492848=95, srv740197273=89, srv439059782=74, srv182725403=39, srv24333107=61, srv1281153862=9, srv1515204081=18, srv2032228005=51, srv2074123017=55, srv1974546281=48, srv941583653=97, srv882545996=94, srv807562882=91, srv578077971=83, srv1626437146=27, srv941358219=96, srv1618000702=25, srv1537485448=20, srv1324117996=11, srv1814831494=38, srv1549515743=21, srv1782493071=37, srv1720286337=32, srv1648214288=28, srv1892553800=43, srv593765778=85, srv2125392605=58, srv1679756893=30, srv1998478790=49, srv1181419079=6, srv1398158267=13, srv1534271997=19, srv2032732550=52, srv46920026=75, srv87965847=93, srv2111740166=57, srv237443660=60, srv1444761873=15, srv1761843129=35, srv434129888=73, srv545012876=80, srv1920596701=45, srv1389182336=12, srv1506403330=17, srv669633164=87, srv1116130210=4, srv1966012667=47, srv262880759=63, srv946523264=99, srv1184524932=7, srv56704155=82, srv1063178941=1, srv372311371=67, srv1615717212=24, srv1623507855=26, srv1578565865=22, srv830946504=92, srv368520816=66, srv1028495956=0, srv228770372=59, srv507040195=78, srv1936206113=46, srv945823283=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-28 13:53:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-28 13:53:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-28 13:53:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-28 13:53:31,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-28 13:53:31,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-28 13:53:31,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-28 13:53:31,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-28 13:53:31,617 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:31,618 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-28 13:53:31,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.985007604585886E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-28 13:53:31,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 369 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 3.985007604585886E-5 to a new imbalance of 6.912120645670642E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:31,882 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1506403330:83 , srv1737661451:83 , srv1762586763:83 , srv1974546281:83 , srv24333107:83 , srv396618376:83 , srv439059782:83 , srv56704155:83 , srv1028495956:84 , srv1063178941:84 , srv1072013866:84 , srv1088450021:84 , srv1116130210:84 , srv112783175:84 , srv1181419079:84 , srv1184524932:84 , srv1225154491:84 , srv1281153862:84 , srv1281278307:84 , srv1389182336:84 , srv1429160797:84 , srv1444761873:84 , srv1488139449:84 , srv1534271997:84 , srv1537485448:84 , srv1549515743:84 , srv1578565865:84 , srv1589363297:84 , srv1615717212:84 , srv1618000702:84 , srv1623507855:84 , srv1626437146:84 , srv1648214288:84 , srv1653863932:84 , srv1679756893:84 , srv1710784940:84 , srv1720286337:84 , srv1750200521:84 , srv1761843129:84 , srv1782493071:84 , srv1814831494:84 , srv1841228016:84 , srv1846016706:84 , srv1856288603:84 , srv1892553800:84 , srv1908675242:84 , srv1920596701:84 , srv1936206113:84 , srv1998478790:84 , srv2025608888:84 , srv2032228005:84 , srv2032732550:84 , srv2042699856:84 , srv2059415768:84 , srv2074123017:84 , srv2085157992:84 , srv2111740166:84 , srv2125392605:84 , srv228770372:84 , srv237443660:84 , srv250791599:84 , srv270489704:84 , srv362023683:84 , srv368520816:84 , srv389666607:84 , srv399253341:84 , srv407382041:84 , srv409790680:84 , srv434129888:84 , srv46920026:84 , srv494206917:84 , srv504712976:84 , srv507040195:84 , srv528975436:84 , srv545012876:84 , srv553853107:84 , srv578209292:84 , srv593765778:84 , srv664866834:84 , srv698195269:84 , srv740197273:84 , srv779719105:84 , srv807562882:84 , srv830946504:84 , srv87965847:84 , srv882545996:84 , srv911492848:84 , srv941358219:84 , srv941583653:84 , srv945823283:84 , srv946523264:84 , srv1398158267:85 , srv1515204081:85 , srv182725403:85 , srv1966012667:85 , srv262880759:85 , srv372311371:85 , srv578077971:85 , srv669633164:85 , srv1324117996:684 }
2024-04-28 13:53:31,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:31,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv399253341=70, srv1750200521=34, srv698195269=88, srv1846016706=41, srv1225154491=8, srv494206917=76, srv1589363297=23, srv1072013866=2, srv779719105=90, srv396618376=69, srv1908675242=44, srv1281278307=10, srv2059415768=54, srv270489704=64, srv2042699856=53, srv578209292=84, srv1841228016=40, srv1856288603=42, srv1488139449=16, srv362023683=65, srv528975436=79, srv250791599=62, srv553853107=81, srv112783175=5, srv1429160797=14, srv504712976=77, srv2025608888=50, srv1737661451=33, srv664866834=86, srv1710784940=31, srv409790680=72, srv1088450021=3, srv389666607=68, srv1762586763=36, srv1653863932=29, srv2085157992=56, srv407382041=71, srv911492848=95, srv740197273=89, srv439059782=74, srv182725403=39, srv24333107=61, srv1281153862=9, srv1515204081=18, srv2032228005=51, srv2074123017=55, srv1974546281=48, srv941583653=97, srv882545996=94, srv807562882=91, srv578077971=83, srv1626437146=27, srv941358219=96, srv1618000702=25, srv1537485448=20, srv1324117996=11, srv1814831494=38, srv1549515743=21, srv1782493071=37, srv1720286337=32, srv1648214288=28, srv1892553800=43, srv593765778=85, srv2125392605=58, srv1679756893=30, srv1998478790=49, srv1181419079=6, srv1398158267=13, srv1534271997=19, srv2032732550=52, srv46920026=75, srv87965847=93, srv2111740166=57, srv237443660=60, srv1444761873=15, srv1761843129=35, srv434129888=73, srv545012876=80, srv1920596701=45, srv1389182336=12, srv1506403330=17, srv669633164=87, srv1116130210=4, srv1966012667=47, srv262880759=63, srv946523264=99, srv1184524932=7, srv56704155=82, srv1063178941=1, srv372311371=67, srv1615717212=24, srv1623507855=26, srv1578565865=22, srv830946504=92, srv368520816=66, srv1028495956=0, srv228770372=59, srv507040195=78, srv1936206113=46, srv945823283=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:31,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:31,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-28 13:53:31,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-28 13:53:31,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-28 13:53:31,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-28 13:53:31,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-28 13:53:31,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-28 13:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-28 13:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-28 13:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-28 13:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-28 13:53:31,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-28 13:53:32,018 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:32,018 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1506403330:83 , srv1737661451:83 , srv1762586763:83 , srv1974546281:83 , srv24333107:83 , srv396618376:83 , srv439059782:83 , srv56704155:83 , srv1028495956:84 , srv1063178941:84 , srv1072013866:84 , srv1088450021:84 , srv1116130210:84 , srv112783175:84 , srv1181419079:84 , srv1184524932:84 , srv1225154491:84 , srv1281153862:84 , srv1281278307:84 , srv1389182336:84 , srv1429160797:84 , srv1444761873:84 , srv1488139449:84 , srv1534271997:84 , srv1537485448:84 , srv1549515743:84 , srv1578565865:84 , srv1589363297:84 , srv1615717212:84 , srv1618000702:84 , srv1623507855:84 , srv1626437146:84 , srv1648214288:84 , srv1653863932:84 , srv1679756893:84 , srv1710784940:84 , srv1720286337:84 , srv1750200521:84 , srv1761843129:84 , srv1782493071:84 , srv1814831494:84 , srv1841228016:84 , srv1846016706:84 , srv1856288603:84 , srv1892553800:84 , srv1908675242:84 , srv1920596701:84 , srv1936206113:84 , srv1998478790:84 , srv2025608888:84 , srv2032228005:84 , srv2032732550:84 , srv2042699856:84 , srv2059415768:84 , srv2074123017:84 , srv2085157992:84 , srv2111740166:84 , srv2125392605:84 , srv228770372:84 , srv237443660:84 , srv250791599:84 , srv270489704:84 , srv362023683:84 , srv368520816:84 , srv389666607:84 , srv399253341:84 , srv407382041:84 , srv409790680:84 , srv434129888:84 , srv46920026:84 , srv494206917:84 , srv504712976:84 , srv507040195:84 , srv528975436:84 , srv545012876:84 , srv553853107:84 , srv578209292:84 , srv593765778:84 , srv664866834:84 , srv698195269:84 , srv740197273:84 , srv779719105:84 , srv807562882:84 , srv830946504:84 , srv87965847:84 , srv882545996:84 , srv911492848:84 , srv941358219:84 , srv941583653:84 , srv945823283:84 , srv946523264:84 , srv1398158267:85 , srv1515204081:85 , srv182725403:85 , srv1966012667:85 , srv262880759:85 , srv372311371:85 , srv578077971:85 , srv669633164:85 , srv1324117996:684 }
2024-04-28 13:53:32,060 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=321 (was 261) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3400 (was 3910)
2024-04-28 13:53:32,073 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=321, ProcessCount=169, AvailableMemoryMB=3400
2024-04-28 13:53:32,074 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-28 13:53:32,074 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-28 13:53:32,090 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv108508775:84 , srv1264308891:84 , srv1287120755:84 , srv1349751536:84 , srv1415460776:84 , srv1452764671:84 , srv1574080874:84 , srv1610334246:84 , srv1654609887:84 , srv1706512177:84 , srv1813212012:84 , srv1820195185:84 , srv1852081879:84 , srv2035327516:84 , srv204331972:84 , srv251362240:84 , srv304095627:84 , srv306934881:84 , srv336619832:84 , srv491982086:84 , srv549008041:84 , srv581131281:84 , srv710751798:84 , srv740914751:84 , srv885074761:84 , srv903635019:84 , srv939816496:84 , srv944178477:84 , srv988205032:84 , srv1922785007:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-28 13:53:32,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:53:32,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1415460776=4, srv204331972=15, srv108508775=0, srv885074761=25, srv1610334246=7, srv549008041=21, srv1922785007=13, srv304095627=17, srv2035327516=14, srv581131281=22, srv491982086=20, srv1264308891=1, srv1852081879=12, srv944178477=28, srv1813212012=10, srv1287120755=2, srv1452764671=5, srv939816496=27, srv1349751536=3, srv306934881=18, srv988205032=29, srv1574080874=6, srv1654609887=8, srv1820195185=11, srv251362240=16, srv1706512177=9, srv710751798=23, srv336619832=19, srv740914751=24, srv903635019=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-28 13:53:32,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1051353038682838, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:53:32,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912524321173785, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1051353038682838, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-28 13:55:32,113 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5621979 different iterations.  Found a solution that moves 1854 regions; Going from a computed imbalance of 0.9912524321173785 to a new imbalance of 4.3273284898463826E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:55:32,119 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv108508775:90 , srv1264308891:90 , srv1287120755:90 , srv1349751536:90 , srv1415460776:90 , srv1452764671:90 , srv1574080874:90 , srv1610334246:90 , srv1654609887:90 , srv1706512177:90 , srv1813212012:90 , srv1820195185:90 , srv1852081879:90 , srv1922785007:90 , srv2035327516:90 , srv204331972:90 , srv251362240:90 , srv304095627:90 , srv306934881:90 , srv336619832:90 , srv491982086:90 , srv549008041:90 , srv581131281:90 , srv710751798:90 , srv740914751:90 , srv885074761:90 , srv903635019:90 , srv939816496:90 , srv944178477:90 , srv988205032:90 }
2024-04-28 13:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-28 13:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1415460776=4, srv204331972=15, srv108508775=0, srv885074761=25, srv1610334246=7, srv549008041=21, srv1922785007=13, srv304095627=17, srv2035327516=14, srv581131281=22, srv491982086=20, srv1264308891=1, srv1852081879=12, srv944178477=28, srv1813212012=10, srv1287120755=2, srv1452764671=5, srv939816496=27, srv1349751536=3, srv306934881=18, srv988205032=29, srv1574080874=6, srv1654609887=8, srv1820195185=11, srv251362240=16, srv1706512177=9, srv710751798=23, srv336619832=19, srv740914751=24, srv903635019=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-28 13:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-28 13:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-28 13:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-28 13:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-28 13:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-28 13:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-28 13:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-28 13:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-28 13:55:32,137 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-28 13:55:32,137 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv108508775:90 , srv1264308891:90 , srv1287120755:90 , srv1349751536:90 , srv1415460776:90 , srv1452764671:90 , srv1574080874:90 , srv1610334246:90 , srv1654609887:90 , srv1706512177:90 , srv1813212012:90 , srv1820195185:90 , srv1852081879:90 , srv1922785007:90 , srv2035327516:90 , srv204331972:90 , srv251362240:90 , srv304095627:90 , srv306934881:90 , srv336619832:90 , srv491982086:90 , srv549008041:90 , srv581131281:90 , srv710751798:90 , srv740914751:90 , srv885074761:90 , srv903635019:90 , srv939816496:90 , srv944178477:90 , srv988205032:90 }
2024-04-28 13:55:32,155 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 321), ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=3305 (was 3400)