2023-10-23 17:53:28,065 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-23 17:53:28,369 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-23 17:53:28,493 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-23 17:53:28,578 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-23 17:53:28,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-23 17:53:28,607 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=170, AvailableMemoryMB=8729
2023-10-23 17:53:28,610 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-23 17:53:28,611 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-23 17:53:28,742 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1024011709:84 , srv1056826099:84 , srv1057861154:84 , srv1139771847:84 , srv1174156694:84 , srv1194105762:84 , srv125710643:84 , srv1301994557:84 , srv1328151594:84 , srv1347356793:84 , srv1356110443:84 , srv1374531626:84 , srv1398476759:84 , srv1401457637:84 , srv1407790663:84 , srv1411467241:84 , srv1420667588:84 , srv1435351174:84 , srv143728710:84 , srv1452088499:84 , srv1474175541:84 , srv1499248389:84 , srv1503336596:84 , srv151714156:84 , srv1525076383:84 , srv1525335502:84 , srv1554915916:84 , srv1561262071:84 , srv1562264829:84 , srv1563448922:84 , srv1608711249:84 , srv1612092063:84 , srv1647990577:84 , srv1691458855:84 , srv1704410:84 , srv1727412981:84 , srv1746348408:84 , srv174883896:84 , srv1780525311:84 , srv1825760853:84 , srv1841930966:84 , srv184863141:84 , srv1873773939:84 , srv1890015507:84 , srv1899419071:84 , srv1922725541:84 , srv1941753691:84 , srv1963833891:84 , srv2001189895:84 , srv2014375584:84 , srv2021058231:84 , srv2038500764:84 , srv2053821655:84 , srv2055379950:84 , srv2073995489:84 , srv2080522139:84 , srv20946481:84 , srv224193518:84 , srv226735087:84 , srv280941246:84 , srv320030764:84 , srv320216854:84 , srv329492902:84 , srv332329240:84 , srv365311490:84 , srv385948027:84 , srv39066972:84 , srv403019247:84 , srv443012964:84 , srv477326803:84 , srv478256608:84 , srv48669620:84 , srv525976924:84 , srv534685206:84 , srv577066774:84 , srv594600219:84 , srv61620371:84 , srv621371061:84 , srv630999498:84 , srv63951002:84 , srv644713983:84 , srv685478439:84 , srv805660341:84 , srv813775213:84 , srv81993704:84 , srv824669390:84 , srv843460724:84 , srv84845756:84 , srv906443634:84 , srv939663857:84 , srv959211188:84 , srv961733847:84 , srv965097913:84 , srv966816435:84 , srv970452224:84 , srv978390722:84 , srv981520961:84 , srv983842946:84 , srv985238433:84 , srv1896188559:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-23 17:53:28,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:28,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv174883896=37, srv1398476759=12, srv1525076383=24, srv48669620=72, srv906443634=89, srv125710643=6, srv2073995489=55, srv959211188=91, srv577066774=75, srv320216854=62, srv630999498=79, srv1174156694=4, srv1896188559=44, srv2080522139=56, srv594600219=76, srv961733847=92, srv1746348408=36, srv2055379950=54, srv84845756=88, srv1890015507=43, srv525976924=73, srv1503336596=22, srv824669390=86, srv1561262071=27, srv226735087=59, srv477326803=70, srv1301994557=7, srv1727412981=35, srv1922725541=46, srv813775213=84, srv644713983=81, srv1525335502=25, srv1562264829=28, srv184863141=41, srv1056826099=1, srv2021058231=51, srv1407790663=14, srv1452088499=19, srv2053821655=53, srv1194105762=5, srv365311490=65, srv805660341=83, srv1780525311=38, srv1563448922=29, srv1356110443=10, srv320030764=61, srv685478439=82, srv81993704=85, srv1704410=34, srv385948027=66, srv534685206=74, srv224193518=58, srv1435351174=17, srv2001189895=49, srv1401457637=13, srv1420667588=16, srv1474175541=20, srv151714156=23, srv621371061=78, srv978390722=96, srv1328151594=8, srv403019247=68, srv280941246=60, srv443012964=69, srv1963833891=48, srv1554915916=26, srv1825760853=39, srv939663857=90, srv985238433=99, srv965097913=93, srv1139771847=3, srv981520961=97, srv478256608=71, srv1374531626=11, srv843460724=87, srv332329240=64, srv970452224=95, srv1608711249=30, srv983842946=98, srv1691458855=33, srv61620371=77, srv1411467241=15, srv1873773939=42, srv1347356793=9, srv2038500764=52, srv2014375584=50, srv1057861154=2, srv39066972=67, srv1612092063=31, srv20946481=57, srv966816435=94, srv1841930966=40, srv329492902=63, srv1941753691=47, srv63951002=80, srv1899419071=45, srv1647990577=32, srv143728710=18, srv1024011709=0, srv1499248389=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:28,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:28,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:28,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-23 17:53:28,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-23 17:53:28,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-23 17:53:28,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-23 17:53:28,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-23 17:53:28,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-23 17:53:28,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-23 17:53:28,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-23 17:53:29,046 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:29,046 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-23 17:53:29,047 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-23 17:53:29,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 609 ms to try 5000 different iterations.  Found a solution that moves 4687 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18269429298601192. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040577880791477665, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05722540934539022, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5207777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040577880791477665, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17741666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:29,497 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1374531626:83 , srv1608711249:83 , srv1612092063:83 , srv365311490:83 , srv478256608:83 , srv534685206:83 , srv630999498:83 , srv84845756:83 , srv1301994557:84 , srv1407790663:84 , srv1554915916:84 , srv1562264829:84 , srv1647990577:84 , srv1873773939:84 , srv2038500764:84 , srv2055379950:84 , srv2080522139:84 , srv20946481:84 , srv280941246:84 , srv577066774:84 , srv594600219:84 , srv644713983:84 , srv1398476759:85 , srv143728710:85 , srv1503336596:85 , srv1563448922:85 , srv184863141:85 , srv224193518:85 , srv320216854:85 , srv48669620:85 , srv805660341:85 , srv824669390:85 , srv970452224:85 , srv985238433:85 , srv1057861154:86 , srv1174156694:86 , srv1411467241:86 , srv1452088499:86 , srv1499248389:86 , srv151714156:86 , srv1561262071:86 , srv1963833891:86 , srv477326803:86 , srv621371061:86 , srv813775213:86 , srv843460724:86 , srv939663857:86 , srv961733847:86 , srv966816435:86 , srv978390722:86 , srv981520961:86 , srv1347356793:87 , srv1435351174:87 , srv1746348408:87 , srv174883896:87 , srv1825760853:87 , srv1890015507:87 , srv1899419071:87 , srv2001189895:87 , srv2021058231:87 , srv2073995489:87 , srv226735087:87 , srv320030764:87 , srv332329240:87 , srv443012964:87 , srv685478439:87 , srv81993704:87 , srv906443634:87 , srv983842946:87 , srv1056826099:88 , srv1139771847:88 , srv1328151594:88 , srv1356110443:88 , srv1401457637:88 , srv1420667588:88 , srv1525076383:88 , srv1525335502:88 , srv1704410:88 , srv1727412981:88 , srv1841930966:88 , srv1922725541:88 , srv2014375584:88 , srv329492902:88 , srv385948027:88 , srv525976924:88 , srv63951002:88 , srv959211188:88 , srv1024011709:89 , srv1194105762:89 , srv1474175541:89 , srv1941753691:89 , srv2053821655:89 , srv61620371:89 , srv125710643:90 , srv1780525311:90 , srv39066972:90 , srv403019247:90 , srv965097913:90 , srv1691458855:93 , srv1896188559:451 }
2023-10-23 17:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:29,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv174883896=37, srv1398476759=12, srv1525076383=24, srv48669620=72, srv906443634=89, srv125710643=6, srv2073995489=55, srv959211188=91, srv577066774=75, srv320216854=62, srv630999498=79, srv1174156694=4, srv1896188559=44, srv2080522139=56, srv594600219=76, srv961733847=92, srv1746348408=36, srv2055379950=54, srv84845756=88, srv1890015507=43, srv525976924=73, srv1503336596=22, srv824669390=86, srv1561262071=27, srv226735087=59, srv477326803=70, srv1301994557=7, srv1727412981=35, srv1922725541=46, srv813775213=84, srv644713983=81, srv1525335502=25, srv1562264829=28, srv184863141=41, srv1056826099=1, srv2021058231=51, srv1407790663=14, srv1452088499=19, srv2053821655=53, srv1194105762=5, srv365311490=65, srv805660341=83, srv1780525311=38, srv1563448922=29, srv1356110443=10, srv320030764=61, srv685478439=82, srv81993704=85, srv1704410=34, srv385948027=66, srv534685206=74, srv224193518=58, srv1435351174=17, srv2001189895=49, srv1401457637=13, srv1420667588=16, srv1474175541=20, srv151714156=23, srv621371061=78, srv978390722=96, srv1328151594=8, srv403019247=68, srv280941246=60, srv443012964=69, srv1963833891=48, srv1554915916=26, srv1825760853=39, srv939663857=90, srv985238433=99, srv965097913=93, srv1139771847=3, srv981520961=97, srv478256608=71, srv1374531626=11, srv843460724=87, srv332329240=64, srv970452224=95, srv1608711249=30, srv983842946=98, srv1691458855=33, srv61620371=77, srv1411467241=15, srv1873773939=42, srv1347356793=9, srv2038500764=52, srv2014375584=50, srv1057861154=2, srv39066972=67, srv1612092063=31, srv20946481=57, srv966816435=94, srv1841930966=40, srv329492902=63, srv1941753691=47, srv63951002=80, srv1899419071=45, srv1647990577=32, srv143728710=18, srv1024011709=0, srv1499248389=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:29,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-23 17:53:29,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-23 17:53:29,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-23 17:53:29,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-23 17:53:29,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-23 17:53:29,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-23 17:53:29,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-23 17:53:29,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-23 17:53:29,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-23 17:53:29,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-23 17:53:29,645 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040577880791477665, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05722540934539022, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040577880791477665, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17741666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:29,645 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-23 17:53:29,645 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18266147391055576, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040577880791477665, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05722540934539022, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040577880791477665, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17741666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-23 17:53:29,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 400 ms to try 5000 different iterations.  Found a solution that moves 2685 regions; Going from a computed imbalance of 0.18266147391055576 to a new imbalance of 0.015393339941341259. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021942686286812774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03703670033516986, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021942686286812774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:29,955 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1024011709:81 , srv403019247:81 , srv1356110443:82 , srv1704410:82 , srv1922725541:82 , srv63951002:82 , srv965097913:82 , srv1139771847:83 , srv125710643:83 , srv1328151594:83 , srv1347356793:83 , srv1525076383:83 , srv1727412981:83 , srv1780525311:83 , srv1841930966:83 , srv332329240:83 , srv385948027:83 , srv39066972:83 , srv443012964:83 , srv61620371:83 , srv1056826099:84 , srv1057861154:84 , srv1194105762:84 , srv1691458855:84 , srv1890015507:84 , srv1941753691:84 , srv2014375584:84 , srv2021058231:84 , srv2053821655:84 , srv320030764:84 , srv329492902:84 , srv685478439:84 , srv959211188:84 , srv1398476759:85 , srv1401457637:85 , srv1420667588:85 , srv1525335502:85 , srv1561262071:85 , srv1746348408:85 , srv174883896:85 , srv1825760853:85 , srv2001189895:85 , srv2073995489:85 , srv813775213:85 , srv81993704:85 , srv824669390:85 , srv939663857:85 , srv961733847:85 , srv1174156694:86 , srv1435351174:86 , srv143728710:86 , srv1474175541:86 , srv1499248389:86 , srv1503336596:86 , srv1554915916:86 , srv1562264829:86 , srv1563448922:86 , srv1873773939:86 , srv1899419071:86 , srv1963833891:86 , srv2055379950:86 , srv20946481:86 , srv226735087:86 , srv477326803:86 , srv525976924:86 , srv805660341:86 , srv843460724:86 , srv966816435:86 , srv970452224:86 , srv978390722:86 , srv983842946:86 , srv1452088499:87 , srv184863141:87 , srv906443634:87 , srv981520961:87 , srv151714156:88 , srv1647990577:88 , srv2038500764:88 , srv224193518:88 , srv621371061:88 , srv630999498:88 , srv644713983:88 , srv985238433:88 , srv1301994557:89 , srv1374531626:89 , srv1411467241:89 , srv1608711249:89 , srv1612092063:89 , srv2080522139:89 , srv320216854:89 , srv48669620:89 , srv577066774:89 , srv594600219:89 , srv365311490:90 , srv84845756:90 , srv1407790663:91 , srv280941246:91 , srv478256608:91 , srv534685206:91 , srv1896188559:518 }
2023-10-23 17:53:29,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:29,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv174883896=37, srv1398476759=12, srv1525076383=24, srv48669620=72, srv906443634=89, srv125710643=6, srv2073995489=55, srv959211188=91, srv577066774=75, srv320216854=62, srv630999498=79, srv1174156694=4, srv1896188559=44, srv2080522139=56, srv594600219=76, srv961733847=92, srv1746348408=36, srv2055379950=54, srv84845756=88, srv1890015507=43, srv525976924=73, srv1503336596=22, srv824669390=86, srv1561262071=27, srv226735087=59, srv477326803=70, srv1301994557=7, srv1727412981=35, srv1922725541=46, srv813775213=84, srv644713983=81, srv1525335502=25, srv1562264829=28, srv184863141=41, srv1056826099=1, srv2021058231=51, srv1407790663=14, srv1452088499=19, srv2053821655=53, srv1194105762=5, srv365311490=65, srv805660341=83, srv1780525311=38, srv1563448922=29, srv1356110443=10, srv320030764=61, srv685478439=82, srv81993704=85, srv1704410=34, srv385948027=66, srv534685206=74, srv224193518=58, srv1435351174=17, srv2001189895=49, srv1401457637=13, srv1420667588=16, srv1474175541=20, srv151714156=23, srv621371061=78, srv978390722=96, srv1328151594=8, srv403019247=68, srv280941246=60, srv443012964=69, srv1963833891=48, srv1554915916=26, srv1825760853=39, srv939663857=90, srv985238433=99, srv965097913=93, srv1139771847=3, srv981520961=97, srv478256608=71, srv1374531626=11, srv843460724=87, srv332329240=64, srv970452224=95, srv1608711249=30, srv983842946=98, srv1691458855=33, srv61620371=77, srv1411467241=15, srv1873773939=42, srv1347356793=9, srv2038500764=52, srv2014375584=50, srv1057861154=2, srv39066972=67, srv1612092063=31, srv20946481=57, srv966816435=94, srv1841930966=40, srv329492902=63, srv1941753691=47, srv63951002=80, srv1899419071=45, srv1647990577=32, srv143728710=18, srv1024011709=0, srv1499248389=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:29,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:29,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:29,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:29,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:29,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:29,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:29,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-23 17:53:29,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-23 17:53:29,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-23 17:53:29,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-23 17:53:29,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-23 17:53:29,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-23 17:53:29,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-23 17:53:30,112 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021942686286812774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03703670033516986, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021942686286812774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:30,112 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-23 17:53:30,113 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015374539169504306, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021942686286812774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03703670033516986, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021942686286812774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-23 17:53:30,403 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 399 ms to try 5000 different iterations.  Found a solution that moves 1026 regions; Going from a computed imbalance of 0.015374539169504306 to a new imbalance of 5.637858232158455E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008122088723203193); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009960640836865495); MoveCostFunction : (multiplier=7.0, imbalance=0.114, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008122088723203193); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:30,405 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1691458855:80 , srv280941246:82 , srv48669620:82 , srv1401457637:83 , srv1407790663:83 , srv1411467241:83 , srv1435351174:83 , srv1474175541:83 , srv151714156:83 , srv2080522139:83 , srv478256608:83 , srv621371061:83 , srv906443634:83 , srv1174156694:84 , srv1301994557:84 , srv1420667588:84 , srv1452088499:84 , srv1525335502:84 , srv1647990577:84 , srv1899419071:84 , srv1941753691:84 , srv2053821655:84 , srv329492902:84 , srv365311490:84 , srv39066972:84 , srv534685206:84 , srv577066774:84 , srv84845756:84 , srv981520961:84 , srv985238433:84 , srv1056826099:85 , srv1194105762:85 , srv125710643:85 , srv1525076383:85 , srv1608711249:85 , srv1612092063:85 , srv1746348408:85 , srv174883896:85 , srv1780525311:85 , srv1825760853:85 , srv184863141:85 , srv2001189895:85 , srv2014375584:85 , srv224193518:85 , srv226735087:85 , srv320216854:85 , srv525976924:85 , srv594600219:85 , srv644713983:85 , srv81993704:85 , srv959211188:85 , srv965097913:85 , srv983842946:85 , srv1024011709:86 , srv1139771847:86 , srv1328151594:86 , srv1374531626:86 , srv1499248389:86 , srv1503336596:86 , srv1563448922:86 , srv1727412981:86 , srv1841930966:86 , srv1890015507:86 , srv2021058231:86 , srv2038500764:86 , srv2055379950:86 , srv2073995489:86 , srv332329240:86 , srv403019247:86 , srv443012964:86 , srv477326803:86 , srv630999498:86 , srv813775213:86 , srv843460724:86 , srv961733847:86 , srv966816435:86 , srv970452224:86 , srv978390722:86 , srv1057861154:87 , srv1347356793:87 , srv1356110443:87 , srv1398476759:87 , srv143728710:87 , srv1554915916:87 , srv1561262071:87 , srv1562264829:87 , srv1922725541:87 , srv1963833891:87 , srv385948027:87 , srv61620371:87 , srv685478439:87 , srv805660341:87 , srv824669390:87 , srv939663857:87 , srv1704410:88 , srv1873773939:88 , srv20946481:88 , srv320030764:88 , srv63951002:88 , srv1896188559:561 }
2023-10-23 17:53:30,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:30,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv174883896=37, srv1398476759=12, srv1525076383=24, srv48669620=72, srv906443634=89, srv125710643=6, srv2073995489=55, srv959211188=91, srv577066774=75, srv320216854=62, srv630999498=79, srv1174156694=4, srv1896188559=44, srv2080522139=56, srv594600219=76, srv961733847=92, srv1746348408=36, srv2055379950=54, srv84845756=88, srv1890015507=43, srv525976924=73, srv1503336596=22, srv824669390=86, srv1561262071=27, srv226735087=59, srv477326803=70, srv1301994557=7, srv1727412981=35, srv1922725541=46, srv813775213=84, srv644713983=81, srv1525335502=25, srv1562264829=28, srv184863141=41, srv1056826099=1, srv2021058231=51, srv1407790663=14, srv1452088499=19, srv2053821655=53, srv1194105762=5, srv365311490=65, srv805660341=83, srv1780525311=38, srv1563448922=29, srv1356110443=10, srv320030764=61, srv685478439=82, srv81993704=85, srv1704410=34, srv385948027=66, srv534685206=74, srv224193518=58, srv1435351174=17, srv2001189895=49, srv1401457637=13, srv1420667588=16, srv1474175541=20, srv151714156=23, srv621371061=78, srv978390722=96, srv1328151594=8, srv403019247=68, srv280941246=60, srv443012964=69, srv1963833891=48, srv1554915916=26, srv1825760853=39, srv939663857=90, srv985238433=99, srv965097913=93, srv1139771847=3, srv981520961=97, srv478256608=71, srv1374531626=11, srv843460724=87, srv332329240=64, srv970452224=95, srv1608711249=30, srv983842946=98, srv1691458855=33, srv61620371=77, srv1411467241=15, srv1873773939=42, srv1347356793=9, srv2038500764=52, srv2014375584=50, srv1057861154=2, srv39066972=67, srv1612092063=31, srv20946481=57, srv966816435=94, srv1841930966=40, srv329492902=63, srv1941753691=47, srv63951002=80, srv1899419071=45, srv1647990577=32, srv143728710=18, srv1024011709=0, srv1499248389=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:30,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:30,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:30,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:30,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-23 17:53:30,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-23 17:53:30,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-23 17:53:30,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-23 17:53:30,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-23 17:53:30,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-23 17:53:30,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-23 17:53:30,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-23 17:53:30,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-23 17:53:30,568 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008122088723203193); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009960640836865495); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008122088723203193); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:30,568 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-23 17:53:30,569 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.566016176647412E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008122088723203193); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009960640836865495); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008122088723203193); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-23 17:53:31,012 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 566 ms to try 5000 different iterations.  Found a solution that moves 269 regions; Going from a computed imbalance of 5.566016176647412E-4 to a new imbalance of 3.07206963408542E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00259499648053841); MoveCostFunction : (multiplier=7.0, imbalance=0.02988888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:31,013 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1374531626:83 , srv1963833891:83 , srv320030764:83 , srv320216854:83 , srv525976924:83 , srv1194105762:84 , srv125710643:84 , srv1411467241:84 , srv143728710:84 , srv1474175541:84 , srv1499248389:84 , srv1554915916:84 , srv1561262071:84 , srv1704410:84 , srv1780525311:84 , srv1841930966:84 , srv1873773939:84 , srv1922725541:84 , srv2038500764:84 , srv2073995489:84 , srv20946481:84 , srv224193518:84 , srv226735087:84 , srv385948027:84 , srv477326803:84 , srv534685206:84 , srv594600219:84 , srv61620371:84 , srv63951002:84 , srv685478439:84 , srv805660341:84 , srv843460724:84 , srv939663857:84 , srv966816435:84 , srv978390722:84 , srv983842946:84 , srv1056826099:85 , srv1057861154:85 , srv1139771847:85 , srv1174156694:85 , srv1301994557:85 , srv1328151594:85 , srv1347356793:85 , srv1356110443:85 , srv1398476759:85 , srv1407790663:85 , srv1420667588:85 , srv1452088499:85 , srv1525076383:85 , srv1525335502:85 , srv1562264829:85 , srv1563448922:85 , srv1608711249:85 , srv1612092063:85 , srv1647990577:85 , srv1727412981:85 , srv1746348408:85 , srv174883896:85 , srv1825760853:85 , srv184863141:85 , srv1890015507:85 , srv1899419071:85 , srv1941753691:85 , srv2021058231:85 , srv2053821655:85 , srv2055379950:85 , srv280941246:85 , srv365311490:85 , srv403019247:85 , srv478256608:85 , srv577066774:85 , srv621371061:85 , srv630999498:85 , srv644713983:85 , srv813775213:85 , srv81993704:85 , srv824669390:85 , srv84845756:85 , srv906443634:85 , srv959211188:85 , srv961733847:85 , srv965097913:85 , srv970452224:85 , srv981520961:85 , srv985238433:85 , srv1024011709:86 , srv1401457637:86 , srv1435351174:86 , srv1503336596:86 , srv151714156:86 , srv1691458855:86 , srv2001189895:86 , srv2014375584:86 , srv2080522139:86 , srv329492902:86 , srv332329240:86 , srv39066972:86 , srv443012964:86 , srv48669620:86 , srv1896188559:612 }
2023-10-23 17:53:31,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:31,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv174883896=37, srv1398476759=12, srv1525076383=24, srv48669620=72, srv906443634=89, srv125710643=6, srv2073995489=55, srv959211188=91, srv577066774=75, srv320216854=62, srv630999498=79, srv1174156694=4, srv1896188559=44, srv2080522139=56, srv594600219=76, srv961733847=92, srv1746348408=36, srv2055379950=54, srv84845756=88, srv1890015507=43, srv525976924=73, srv1503336596=22, srv824669390=86, srv1561262071=27, srv226735087=59, srv477326803=70, srv1301994557=7, srv1727412981=35, srv1922725541=46, srv813775213=84, srv644713983=81, srv1525335502=25, srv1562264829=28, srv184863141=41, srv1056826099=1, srv2021058231=51, srv1407790663=14, srv1452088499=19, srv2053821655=53, srv1194105762=5, srv365311490=65, srv805660341=83, srv1780525311=38, srv1563448922=29, srv1356110443=10, srv320030764=61, srv685478439=82, srv81993704=85, srv1704410=34, srv385948027=66, srv534685206=74, srv224193518=58, srv1435351174=17, srv2001189895=49, srv1401457637=13, srv1420667588=16, srv1474175541=20, srv151714156=23, srv621371061=78, srv978390722=96, srv1328151594=8, srv403019247=68, srv280941246=60, srv443012964=69, srv1963833891=48, srv1554915916=26, srv1825760853=39, srv939663857=90, srv985238433=99, srv965097913=93, srv1139771847=3, srv981520961=97, srv478256608=71, srv1374531626=11, srv843460724=87, srv332329240=64, srv970452224=95, srv1608711249=30, srv983842946=98, srv1691458855=33, srv61620371=77, srv1411467241=15, srv1873773939=42, srv1347356793=9, srv2038500764=52, srv2014375584=50, srv1057861154=2, srv39066972=67, srv1612092063=31, srv20946481=57, srv966816435=94, srv1841930966=40, srv329492902=63, srv1941753691=47, srv63951002=80, srv1899419071=45, srv1647990577=32, srv143728710=18, srv1024011709=0, srv1499248389=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-23 17:53:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-23 17:53:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-23 17:53:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-23 17:53:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-23 17:53:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-23 17:53:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-23 17:53:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-23 17:53:31,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00259499648053841); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:31,189 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-23 17:53:31,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.8837118082328832E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00259499648053841); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-23 17:53:31,434 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 376 ms to try 5000 different iterations.  Found a solution that moves 35 regions; Going from a computed imbalance of 2.8837118082328832E-5 to a new imbalance of 8.224765355138684E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0038888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:31,435 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1407790663:83 , srv1503336596:83 , srv151714156:83 , srv1691458855:83 , srv2001189895:83 , srv2014375584:83 , srv39066972:83 , srv61620371:83 , srv1024011709:84 , srv1056826099:84 , srv1057861154:84 , srv1139771847:84 , srv1194105762:84 , srv125710643:84 , srv1301994557:84 , srv1328151594:84 , srv1347356793:84 , srv1356110443:84 , srv1398476759:84 , srv1401457637:84 , srv1411467241:84 , srv1420667588:84 , srv1435351174:84 , srv143728710:84 , srv1452088499:84 , srv1474175541:84 , srv1499248389:84 , srv1525335502:84 , srv1561262071:84 , srv1562264829:84 , srv1563448922:84 , srv1608711249:84 , srv1612092063:84 , srv1704410:84 , srv1727412981:84 , srv1746348408:84 , srv174883896:84 , srv1780525311:84 , srv1825760853:84 , srv184863141:84 , srv1873773939:84 , srv1890015507:84 , srv1899419071:84 , srv1941753691:84 , srv1963833891:84 , srv2021058231:84 , srv2038500764:84 , srv2053821655:84 , srv2073995489:84 , srv2080522139:84 , srv20946481:84 , srv224193518:84 , srv226735087:84 , srv280941246:84 , srv320030764:84 , srv320216854:84 , srv329492902:84 , srv332329240:84 , srv365311490:84 , srv385948027:84 , srv403019247:84 , srv443012964:84 , srv477326803:84 , srv478256608:84 , srv48669620:84 , srv525976924:84 , srv534685206:84 , srv577066774:84 , srv594600219:84 , srv621371061:84 , srv630999498:84 , srv63951002:84 , srv644713983:84 , srv685478439:84 , srv805660341:84 , srv813775213:84 , srv81993704:84 , srv824669390:84 , srv843460724:84 , srv84845756:84 , srv906443634:84 , srv939663857:84 , srv959211188:84 , srv961733847:84 , srv965097913:84 , srv966816435:84 , srv970452224:84 , srv978390722:84 , srv981520961:84 , srv983842946:84 , srv985238433:84 , srv1174156694:85 , srv1374531626:85 , srv1525076383:85 , srv1554915916:85 , srv1647990577:85 , srv1841930966:85 , srv1922725541:85 , srv2055379950:85 , srv1896188559:684 }
2023-10-23 17:53:31,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:31,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv174883896=37, srv1398476759=12, srv1525076383=24, srv48669620=72, srv906443634=89, srv125710643=6, srv2073995489=55, srv959211188=91, srv577066774=75, srv320216854=62, srv630999498=79, srv1174156694=4, srv1896188559=44, srv2080522139=56, srv594600219=76, srv961733847=92, srv1746348408=36, srv2055379950=54, srv84845756=88, srv1890015507=43, srv525976924=73, srv1503336596=22, srv824669390=86, srv1561262071=27, srv226735087=59, srv477326803=70, srv1301994557=7, srv1727412981=35, srv1922725541=46, srv813775213=84, srv644713983=81, srv1525335502=25, srv1562264829=28, srv184863141=41, srv1056826099=1, srv2021058231=51, srv1407790663=14, srv1452088499=19, srv2053821655=53, srv1194105762=5, srv365311490=65, srv805660341=83, srv1780525311=38, srv1563448922=29, srv1356110443=10, srv320030764=61, srv685478439=82, srv81993704=85, srv1704410=34, srv385948027=66, srv534685206=74, srv224193518=58, srv1435351174=17, srv2001189895=49, srv1401457637=13, srv1420667588=16, srv1474175541=20, srv151714156=23, srv621371061=78, srv978390722=96, srv1328151594=8, srv403019247=68, srv280941246=60, srv443012964=69, srv1963833891=48, srv1554915916=26, srv1825760853=39, srv939663857=90, srv985238433=99, srv965097913=93, srv1139771847=3, srv981520961=97, srv478256608=71, srv1374531626=11, srv843460724=87, srv332329240=64, srv970452224=95, srv1608711249=30, srv983842946=98, srv1691458855=33, srv61620371=77, srv1411467241=15, srv1873773939=42, srv1347356793=9, srv2038500764=52, srv2014375584=50, srv1057861154=2, srv39066972=67, srv1612092063=31, srv20946481=57, srv966816435=94, srv1841930966=40, srv329492902=63, srv1941753691=47, srv63951002=80, srv1899419071=45, srv1647990577=32, srv143728710=18, srv1024011709=0, srv1499248389=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:31,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:31,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:31,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:31,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:31,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:31,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-23 17:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-23 17:53:31,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-23 17:53:31,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-23 17:53:31,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-23 17:53:31,564 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:31,564 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1407790663:83 , srv1503336596:83 , srv151714156:83 , srv1691458855:83 , srv2001189895:83 , srv2014375584:83 , srv39066972:83 , srv61620371:83 , srv1024011709:84 , srv1056826099:84 , srv1057861154:84 , srv1139771847:84 , srv1194105762:84 , srv125710643:84 , srv1301994557:84 , srv1328151594:84 , srv1347356793:84 , srv1356110443:84 , srv1398476759:84 , srv1401457637:84 , srv1411467241:84 , srv1420667588:84 , srv1435351174:84 , srv143728710:84 , srv1452088499:84 , srv1474175541:84 , srv1499248389:84 , srv1525335502:84 , srv1561262071:84 , srv1562264829:84 , srv1563448922:84 , srv1608711249:84 , srv1612092063:84 , srv1704410:84 , srv1727412981:84 , srv1746348408:84 , srv174883896:84 , srv1780525311:84 , srv1825760853:84 , srv184863141:84 , srv1873773939:84 , srv1890015507:84 , srv1899419071:84 , srv1941753691:84 , srv1963833891:84 , srv2021058231:84 , srv2038500764:84 , srv2053821655:84 , srv2073995489:84 , srv2080522139:84 , srv20946481:84 , srv224193518:84 , srv226735087:84 , srv280941246:84 , srv320030764:84 , srv320216854:84 , srv329492902:84 , srv332329240:84 , srv365311490:84 , srv385948027:84 , srv403019247:84 , srv443012964:84 , srv477326803:84 , srv478256608:84 , srv48669620:84 , srv525976924:84 , srv534685206:84 , srv577066774:84 , srv594600219:84 , srv621371061:84 , srv630999498:84 , srv63951002:84 , srv644713983:84 , srv685478439:84 , srv805660341:84 , srv813775213:84 , srv81993704:84 , srv824669390:84 , srv843460724:84 , srv84845756:84 , srv906443634:84 , srv939663857:84 , srv959211188:84 , srv961733847:84 , srv965097913:84 , srv966816435:84 , srv970452224:84 , srv978390722:84 , srv981520961:84 , srv983842946:84 , srv985238433:84 , srv1174156694:85 , srv1374531626:85 , srv1525076383:85 , srv1554915916:85 , srv1647990577:85 , srv1841930966:85 , srv1922725541:85 , srv2055379950:85 , srv1896188559:684 }
2023-10-23 17:53:31,587 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=345 (was 331) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8226 (was 8729)
2023-10-23 17:53:31,595 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=345, ProcessCount=170, AvailableMemoryMB=8226
2023-10-23 17:53:31,595 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-23 17:53:31,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-23 17:53:31,605 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1156976360:84 , srv1159975519:84 , srv1248918364:84 , srv1271404659:84 , srv1335737007:84 , srv1453193261:84 , srv1457364379:84 , srv1493870367:84 , srv1561331533:84 , srv1742725748:84 , srv1759851603:84 , srv1770011230:84 , srv1781569320:84 , srv1868141364:84 , srv1884744602:84 , srv1886895477:84 , srv1918189100:84 , srv230720069:84 , srv283608883:84 , srv415681216:84 , srv480163735:84 , srv480216587:84 , srv548621001:84 , srv570376768:84 , srv595125290:84 , srv650753617:84 , srv688718709:84 , srv862886579:84 , srv864717524:84 , srv791885984:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-23 17:53:31,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:53:31,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv480163735=20, srv230720069=17, srv570376768=23, srv1457364379=6, srv1884744602=14, srv1156976360=0, srv1453193261=5, srv1742725748=9, srv862886579=28, srv1248918364=2, srv1770011230=11, srv1886895477=15, srv595125290=24, srv480216587=21, srv1561331533=8, srv283608883=18, srv1335737007=4, srv1271404659=3, srv1159975519=1, srv1759851603=10, srv415681216=19, srv1493870367=7, srv1781569320=12, srv1918189100=16, srv650753617=25, srv1868141364=13, srv688718709=26, srv864717524=29, srv791885984=27, srv548621001=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:53:31,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:53:31,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:53:31,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:53:31,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-23 17:53:31,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.09559462340704, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:53:31,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912494258801183, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.09559462340704, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-23 17:55:31,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5603635 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912494258801183 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:55:31,629 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1156976360:90 , srv1159975519:90 , srv1248918364:90 , srv1271404659:90 , srv1335737007:90 , srv1453193261:90 , srv1457364379:90 , srv1493870367:90 , srv1561331533:90 , srv1742725748:90 , srv1759851603:90 , srv1770011230:90 , srv1781569320:90 , srv1868141364:90 , srv1884744602:90 , srv1886895477:90 , srv1918189100:90 , srv230720069:90 , srv283608883:90 , srv415681216:90 , srv480163735:90 , srv480216587:90 , srv548621001:90 , srv570376768:90 , srv595125290:90 , srv650753617:90 , srv688718709:90 , srv791885984:90 , srv862886579:90 , srv864717524:90 }
2023-10-23 17:55:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-23 17:55:31,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv480163735=20, srv230720069=17, srv570376768=23, srv1457364379=6, srv1884744602=14, srv1156976360=0, srv1453193261=5, srv1742725748=9, srv862886579=28, srv1248918364=2, srv1770011230=11, srv1886895477=15, srv595125290=24, srv480216587=21, srv1561331533=8, srv283608883=18, srv1335737007=4, srv1271404659=3, srv1159975519=1, srv1759851603=10, srv415681216=19, srv1493870367=7, srv1781569320=12, srv1918189100=16, srv650753617=25, srv1868141364=13, srv688718709=26, srv864717524=29, srv791885984=27, srv548621001=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-23 17:55:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-23 17:55:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-23 17:55:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-23 17:55:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-23 17:55:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-23 17:55:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-23 17:55:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-23 17:55:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-23 17:55:31,655 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-23 17:55:31,655 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1156976360:90 , srv1159975519:90 , srv1248918364:90 , srv1271404659:90 , srv1335737007:90 , srv1453193261:90 , srv1457364379:90 , srv1493870367:90 , srv1561331533:90 , srv1742725748:90 , srv1759851603:90 , srv1770011230:90 , srv1781569320:90 , srv1868141364:90 , srv1884744602:90 , srv1886895477:90 , srv1918189100:90 , srv230720069:90 , srv283608883:90 , srv415681216:90 , srv480163735:90 , srv480216587:90 , srv548621001:90 , srv570376768:90 , srv595125290:90 , srv650753617:90 , srv688718709:90 , srv791885984:90 , srv862886579:90 , srv864717524:90 }
2023-10-23 17:55:31,672 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 345), ProcessCount=167 (was 170), AvailableMemoryMB=7946 (was 8226)