2023-10-30 06:56:48,080 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-30 06:56:48,316 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-30 06:56:48,406 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-30 06:56:48,463 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 06:56:48,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-30 06:56:48,485 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=167, AvailableMemoryMB=3360
2023-10-30 06:56:48,487 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 06:56:48,487 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-30 06:56:48,589 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014641875:84 , srv1025641673:84 , srv1035486884:84 , srv1047708174:84 , srv1100436802:84 , srv1128595809:84 , srv1129350791:84 , srv1145656401:84 , srv1155181520:84 , srv1174633534:84 , srv1207563177:84 , srv1265237307:84 , srv1271028058:84 , srv134376301:84 , srv1350901850:84 , srv1366218875:84 , srv1372372792:84 , srv1384945466:84 , srv1389895123:84 , srv1396100411:84 , srv1396450700:84 , srv1407315895:84 , srv1438889776:84 , srv1458279216:84 , srv1466270808:84 , srv1485357301:84 , srv1488486767:84 , srv1528739707:84 , srv1547695204:84 , srv1550895362:84 , srv1562050988:84 , srv1569055217:84 , srv1607973024:84 , srv1627330011:84 , srv1631852059:84 , srv1639639329:84 , srv1659720864:84 , srv1660769851:84 , srv1668297694:84 , srv1676644993:84 , srv1701499704:84 , srv1723065474:84 , srv1724571676:84 , srv173318735:84 , srv1756749426:84 , srv1847610327:84 , srv1850795912:84 , srv1877264562:84 , srv1884249536:84 , srv1909403136:84 , srv1933022793:84 , srv1946808658:84 , srv1986318386:84 , srv2030279198:84 , srv2034461299:84 , srv2076758004:84 , srv207988732:84 , srv2123131924:84 , srv2123167551:84 , srv216076522:84 , srv22683166:84 , srv235172253:84 , srv255796183:84 , srv270261744:84 , srv284736998:84 , srv288133741:84 , srv333382645:84 , srv340793635:84 , srv356928100:84 , srv386155946:84 , srv397897534:84 , srv413373908:84 , srv420119911:84 , srv421052300:84 , srv467882627:84 , srv495163837:84 , srv509100539:84 , srv511489749:84 , srv527551688:84 , srv545762369:84 , srv576014396:84 , srv58735877:84 , srv61700590:84 , srv627976338:84 , srv678574912:84 , srv683988173:84 , srv717269091:84 , srv723155443:84 , srv728977699:84 , srv757818973:84 , srv772843714:84 , srv873534756:84 , srv8860800:84 , srv914335485:84 , srv919773171:84 , srv947096351:84 , srv960085707:84 , srv962681472:84 , srv978268739:84 , srv1096146226:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-30 06:56:48,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:48,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1014641875=0, srv1207563177=11, srv2030279198=54, srv1100436802=5, srv947096351=96, srv1528739707=28, srv1756749426=45, srv235172253=62, srv1550895362=30, srv356928100=69, srv1128595809=6, srv511489749=78, srv1986318386=53, srv333382645=67, srv1850795912=47, srv1701499704=41, srv772843714=91, srv1438889776=23, srv1946808658=52, srv1466270808=25, srv58735877=82, srv1458279216=24, srv1631852059=35, srv1265237307=12, srv1035486884=2, srv1271028058=13, srv1174633534=10, srv509100539=77, srv717269091=87, srv1607973024=33, srv1659720864=37, srv270261744=64, srv576014396=81, srv1723065474=42, srv8860800=93, srv962681472=98, srv1627330011=34, srv173318735=44, srv340793635=68, srv627976338=84, srv2034461299=55, srv1396100411=20, srv1639639329=36, srv386155946=70, srv1547695204=29, srv678574912=85, srv1396450700=21, srv397897534=71, srv61700590=83, srv495163837=76, srv1660769851=38, srv1145656401=8, srv683988173=86, srv723155443=88, srv413373908=72, srv1350901850=15, srv1485357301=26, srv1562050988=31, srv1047708174=3, srv1389895123=19, srv1155181520=9, srv1884249536=49, srv1407315895=22, srv527551688=79, srv1569055217=32, srv2123131924=58, srv728977699=89, srv255796183=63, srv284736998=65, srv467882627=75, srv2076758004=56, srv1488486767=27, srv134376301=14, srv1909403136=50, srv1933022793=51, srv216076522=60, srv914335485=94, srv2123167551=59, srv420119911=73, srv1129350791=7, srv1668297694=39, srv22683166=61, srv1096146226=4, srv1025641673=1, srv1877264562=48, srv1384945466=18, srv207988732=57, srv288133741=66, srv1372372792=17, srv1847610327=46, srv919773171=95, srv960085707=97, srv873534756=92, srv978268739=99, srv1676644993=40, srv1366218875=16, srv1724571676=43, srv757818973=90, srv421052300=74, srv545762369=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:48,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:48,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:48,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:48,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:48,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:48,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 06:56:48,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 06:56:48,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 06:56:48,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 06:56:48,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 06:56:48,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 06:56:48,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 06:56:48,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 06:56:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 06:56:48,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:48,801 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 06:56:48,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 06:56:49,119 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 428 ms to try 5000 different iterations.  Found a solution that moves 4704 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1836242128418957. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039707434871668446, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05804909103247844, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5226666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039707434871668446, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:49,128 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1407315895:81 , srv1035486884:82 , srv467882627:82 , srv683988173:82 , srv717269091:82 , srv1025641673:83 , srv1174633534:83 , srv1396100411:83 , srv1438889776:83 , srv1668297694:83 , srv576014396:83 , srv1047708174:84 , srv1128595809:84 , srv1724571676:84 , srv1850795912:84 , srv1909403136:84 , srv333382645:84 , srv340793635:84 , srv356928100:84 , srv757818973:84 , srv960085707:84 , srv1372372792:85 , srv1384945466:85 , srv1550895362:85 , srv1562050988:85 , srv1660769851:85 , srv173318735:85 , srv1847610327:85 , srv1884249536:85 , srv2030279198:85 , srv207988732:85 , srv235172253:85 , srv270261744:85 , srv288133741:85 , srv728977699:85 , srv947096351:85 , srv1155181520:86 , srv134376301:86 , srv1485357301:86 , srv1569055217:86 , srv1627330011:86 , srv1659720864:86 , srv1946808658:86 , srv1986318386:86 , srv2123131924:86 , srv284736998:86 , srv58735877:86 , srv678574912:86 , srv723155443:86 , srv919773171:86 , srv962681472:86 , srv1100436802:87 , srv1265237307:87 , srv1396450700:87 , srv1488486767:87 , srv1631852059:87 , srv1639639329:87 , srv1723065474:87 , srv2076758004:87 , srv22683166:87 , srv397897534:87 , srv413373908:87 , srv421052300:87 , srv495163837:87 , srv61700590:87 , srv627976338:87 , srv772843714:87 , srv978268739:87 , srv1350901850:88 , srv1389895123:88 , srv1458279216:88 , srv1607973024:88 , srv1676644993:88 , srv255796183:88 , srv386155946:88 , srv420119911:88 , srv511489749:88 , srv545762369:88 , srv1207563177:89 , srv1366218875:89 , srv1466270808:89 , srv1701499704:89 , srv1877264562:89 , srv2034461299:89 , srv216076522:89 , srv509100539:89 , srv527551688:89 , srv8860800:89 , srv914335485:89 , srv1014641875:90 , srv1145656401:90 , srv1271028058:90 , srv1756749426:90 , srv1933022793:90 , srv2123167551:90 , srv1129350791:91 , srv1547695204:91 , srv1528739707:92 , srv873534756:93 , srv1096146226:443 }
2023-10-30 06:56:49,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:49,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1014641875=0, srv1207563177=11, srv2030279198=54, srv1100436802=5, srv947096351=96, srv1528739707=28, srv1756749426=45, srv235172253=62, srv1550895362=30, srv356928100=69, srv1128595809=6, srv511489749=78, srv1986318386=53, srv333382645=67, srv1850795912=47, srv1701499704=41, srv772843714=91, srv1438889776=23, srv1946808658=52, srv1466270808=25, srv58735877=82, srv1458279216=24, srv1631852059=35, srv1265237307=12, srv1035486884=2, srv1271028058=13, srv1174633534=10, srv509100539=77, srv717269091=87, srv1607973024=33, srv1659720864=37, srv270261744=64, srv576014396=81, srv1723065474=42, srv8860800=93, srv962681472=98, srv1627330011=34, srv173318735=44, srv340793635=68, srv627976338=84, srv2034461299=55, srv1396100411=20, srv1639639329=36, srv386155946=70, srv1547695204=29, srv678574912=85, srv1396450700=21, srv397897534=71, srv61700590=83, srv495163837=76, srv1660769851=38, srv1145656401=8, srv683988173=86, srv723155443=88, srv413373908=72, srv1350901850=15, srv1485357301=26, srv1562050988=31, srv1047708174=3, srv1389895123=19, srv1155181520=9, srv1884249536=49, srv1407315895=22, srv527551688=79, srv1569055217=32, srv2123131924=58, srv728977699=89, srv255796183=63, srv284736998=65, srv467882627=75, srv2076758004=56, srv1488486767=27, srv134376301=14, srv1909403136=50, srv1933022793=51, srv216076522=60, srv914335485=94, srv2123167551=59, srv420119911=73, srv1129350791=7, srv1668297694=39, srv22683166=61, srv1096146226=4, srv1025641673=1, srv1877264562=48, srv1384945466=18, srv207988732=57, srv288133741=66, srv1372372792=17, srv1847610327=46, srv919773171=95, srv960085707=97, srv873534756=92, srv978268739=99, srv1676644993=40, srv1366218875=16, srv1724571676=43, srv757818973=90, srv421052300=74, srv545762369=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:49,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:49,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 06:56:49,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 06:56:49,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 06:56:49,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 06:56:49,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 06:56:49,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 06:56:49,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 06:56:49,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039707434871668446, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05804909103247844, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039707434871668446, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:49,256 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 06:56:49,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1835912747298953, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039707434871668446, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05804909103247844, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039707434871668446, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 06:56:49,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 263 ms to try 5000 different iterations.  Found a solution that moves 2633 regions; Going from a computed imbalance of 0.1835912747298953 to a new imbalance of 0.014414023620030234. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023612513987504084); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03777183553978934, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29255555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023612513987504084); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:49,443 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1528739707:78 , srv1014641875:80 , srv1129350791:81 , srv1145656401:81 , srv509100539:81 , srv873534756:81 , srv1271028058:82 , srv1350901850:82 , srv1466270808:82 , srv1877264562:82 , srv1389895123:83 , srv1547695204:83 , srv1569055217:83 , srv1676644993:83 , srv1701499704:83 , srv1756749426:83 , srv1933022793:83 , srv284736998:83 , srv420119911:83 , srv511489749:83 , srv1100436802:84 , srv1207563177:84 , srv1607973024:84 , srv1627330011:84 , srv1631852059:84 , srv1639639329:84 , srv1723065474:84 , srv1946808658:84 , srv2123167551:84 , srv386155946:84 , srv413373908:84 , srv495163837:84 , srv527551688:84 , srv545762369:84 , srv8860800:84 , srv1366218875:85 , srv1458279216:85 , srv1488486767:85 , srv1847610327:85 , srv2034461299:85 , srv2076758004:85 , srv216076522:85 , srv421052300:85 , srv61700590:85 , srv678574912:85 , srv723155443:85 , srv914335485:85 , srv1265237307:86 , srv134376301:86 , srv1372372792:86 , srv1384945466:86 , srv1485357301:86 , srv1562050988:86 , srv1660769851:86 , srv1724571676:86 , srv1884249536:86 , srv1909403136:86 , srv1986318386:86 , srv2030279198:86 , srv255796183:86 , srv333382645:86 , srv397897534:86 , srv772843714:86 , srv919773171:86 , srv960085707:86 , srv978268739:86 , srv1155181520:87 , srv1396450700:87 , srv1550895362:87 , srv1659720864:87 , srv2123131924:87 , srv22683166:87 , srv270261744:87 , srv288133741:87 , srv627976338:87 , srv728977699:87 , srv947096351:87 , srv1025641673:88 , srv1047708174:88 , srv1174633534:88 , srv1438889776:88 , srv1668297694:88 , srv173318735:88 , srv1850795912:88 , srv207988732:88 , srv235172253:88 , srv340793635:88 , srv356928100:88 , srv58735877:88 , srv683988173:88 , srv757818973:88 , srv962681472:88 , srv1035486884:89 , srv1128595809:89 , srv1396100411:89 , srv576014396:89 , srv1407315895:90 , srv717269091:90 , srv467882627:92 , srv1096146226:541 }
2023-10-30 06:56:49,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:49,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1014641875=0, srv1207563177=11, srv2030279198=54, srv1100436802=5, srv947096351=96, srv1528739707=28, srv1756749426=45, srv235172253=62, srv1550895362=30, srv356928100=69, srv1128595809=6, srv511489749=78, srv1986318386=53, srv333382645=67, srv1850795912=47, srv1701499704=41, srv772843714=91, srv1438889776=23, srv1946808658=52, srv1466270808=25, srv58735877=82, srv1458279216=24, srv1631852059=35, srv1265237307=12, srv1035486884=2, srv1271028058=13, srv1174633534=10, srv509100539=77, srv717269091=87, srv1607973024=33, srv1659720864=37, srv270261744=64, srv576014396=81, srv1723065474=42, srv8860800=93, srv962681472=98, srv1627330011=34, srv173318735=44, srv340793635=68, srv627976338=84, srv2034461299=55, srv1396100411=20, srv1639639329=36, srv386155946=70, srv1547695204=29, srv678574912=85, srv1396450700=21, srv397897534=71, srv61700590=83, srv495163837=76, srv1660769851=38, srv1145656401=8, srv683988173=86, srv723155443=88, srv413373908=72, srv1350901850=15, srv1485357301=26, srv1562050988=31, srv1047708174=3, srv1389895123=19, srv1155181520=9, srv1884249536=49, srv1407315895=22, srv527551688=79, srv1569055217=32, srv2123131924=58, srv728977699=89, srv255796183=63, srv284736998=65, srv467882627=75, srv2076758004=56, srv1488486767=27, srv134376301=14, srv1909403136=50, srv1933022793=51, srv216076522=60, srv914335485=94, srv2123167551=59, srv420119911=73, srv1129350791=7, srv1668297694=39, srv22683166=61, srv1096146226=4, srv1025641673=1, srv1877264562=48, srv1384945466=18, srv207988732=57, srv288133741=66, srv1372372792=17, srv1847610327=46, srv919773171=95, srv960085707=97, srv873534756=92, srv978268739=99, srv1676644993=40, srv1366218875=16, srv1724571676=43, srv757818973=90, srv421052300=74, srv545762369=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:49,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:49,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:49,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 06:56:49,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 06:56:49,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 06:56:49,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 06:56:49,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 06:56:49,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 06:56:49,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 06:56:49,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 06:56:49,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 06:56:49,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 06:56:49,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 06:56:49,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 06:56:49,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 06:56:49,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 06:56:49,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023612513987504084); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03777183553978934, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023612513987504084); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:49,571 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 06:56:49,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014395586959975596, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023612513987504084); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03777183553978934, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023612513987504084); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 06:56:49,729 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 229 ms to try 5000 different iterations.  Found a solution that moves 996 regions; Going from a computed imbalance of 0.014395586959975596 to a new imbalance of 9.204422475141457E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00823340762517771); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01245418089531738); MoveCostFunction : (multiplier=7.0, imbalance=0.11066666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00823340762517771); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:49,731 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1155181520:83 , srv1396450700:83 , srv255796183:83 , srv58735877:83 , srv627976338:83 , srv772843714:83 , srv873534756:83 , srv962681472:83 , srv1128595809:84 , srv1207563177:84 , srv1271028058:84 , srv1366218875:84 , srv1458279216:84 , srv1547695204:84 , srv173318735:84 , srv1933022793:84 , srv2034461299:84 , srv2123131924:84 , srv2123167551:84 , srv216076522:84 , srv22683166:84 , srv235172253:84 , srv397897534:84 , srv467882627:84 , srv527551688:84 , srv61700590:84 , srv717269091:84 , srv728977699:84 , srv8860800:84 , srv978268739:84 , srv1035486884:85 , srv1129350791:85 , srv1265237307:85 , srv1384945466:85 , srv1396100411:85 , srv1438889776:85 , srv1488486767:85 , srv1550895362:85 , srv1562050988:85 , srv1631852059:85 , srv1659720864:85 , srv1668297694:85 , srv1701499704:85 , srv1756749426:85 , srv1850795912:85 , srv2076758004:85 , srv207988732:85 , srv270261744:85 , srv288133741:85 , srv340793635:85 , srv356928100:85 , srv386155946:85 , srv576014396:85 , srv757818973:85 , srv914335485:85 , srv947096351:85 , srv1047708174:86 , srv1100436802:86 , srv1174633534:86 , srv1372372792:86 , srv1389895123:86 , srv1407315895:86 , srv1485357301:86 , srv1607973024:86 , srv1639639329:86 , srv1660769851:86 , srv1723065474:86 , srv1986318386:86 , srv2030279198:86 , srv420119911:86 , srv421052300:86 , srv495163837:86 , srv545762369:86 , srv678574912:86 , srv919773171:86 , srv1014641875:87 , srv1025641673:87 , srv1145656401:87 , srv1528739707:87 , srv1627330011:87 , srv1676644993:87 , srv1847610327:87 , srv1877264562:87 , srv1884249536:87 , srv1946808658:87 , srv413373908:87 , srv509100539:87 , srv511489749:87 , srv683988173:87 , srv723155443:87 , srv960085707:87 , srv134376301:88 , srv1350901850:88 , srv1466270808:88 , srv1569055217:88 , srv1724571676:88 , srv1909403136:88 , srv333382645:88 , srv284736998:89 , srv1096146226:547 }
2023-10-30 06:56:49,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:49,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1014641875=0, srv1207563177=11, srv2030279198=54, srv1100436802=5, srv947096351=96, srv1528739707=28, srv1756749426=45, srv235172253=62, srv1550895362=30, srv356928100=69, srv1128595809=6, srv511489749=78, srv1986318386=53, srv333382645=67, srv1850795912=47, srv1701499704=41, srv772843714=91, srv1438889776=23, srv1946808658=52, srv1466270808=25, srv58735877=82, srv1458279216=24, srv1631852059=35, srv1265237307=12, srv1035486884=2, srv1271028058=13, srv1174633534=10, srv509100539=77, srv717269091=87, srv1607973024=33, srv1659720864=37, srv270261744=64, srv576014396=81, srv1723065474=42, srv8860800=93, srv962681472=98, srv1627330011=34, srv173318735=44, srv340793635=68, srv627976338=84, srv2034461299=55, srv1396100411=20, srv1639639329=36, srv386155946=70, srv1547695204=29, srv678574912=85, srv1396450700=21, srv397897534=71, srv61700590=83, srv495163837=76, srv1660769851=38, srv1145656401=8, srv683988173=86, srv723155443=88, srv413373908=72, srv1350901850=15, srv1485357301=26, srv1562050988=31, srv1047708174=3, srv1389895123=19, srv1155181520=9, srv1884249536=49, srv1407315895=22, srv527551688=79, srv1569055217=32, srv2123131924=58, srv728977699=89, srv255796183=63, srv284736998=65, srv467882627=75, srv2076758004=56, srv1488486767=27, srv134376301=14, srv1909403136=50, srv1933022793=51, srv216076522=60, srv914335485=94, srv2123167551=59, srv420119911=73, srv1129350791=7, srv1668297694=39, srv22683166=61, srv1096146226=4, srv1025641673=1, srv1877264562=48, srv1384945466=18, srv207988732=57, srv288133741=66, srv1372372792=17, srv1847610327=46, srv919773171=95, srv960085707=97, srv873534756=92, srv978268739=99, srv1676644993=40, srv1366218875=16, srv1724571676=43, srv757818973=90, srv421052300=74, srv545762369=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:49,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 06:56:49,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 06:56:49,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 06:56:49,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 06:56:49,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 06:56:49,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 06:56:49,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 06:56:49,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 06:56:49,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 06:56:49,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 06:56:49,828 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00823340762517771); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01245418089531738); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00823340762517771); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:49,828 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 06:56:49,828 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.1346810645284E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00823340762517771); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01245418089531738); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00823340762517771); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 06:56:50,046 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 287 ms to try 5000 different iterations.  Found a solution that moves 308 regions; Going from a computed imbalance of 9.1346810645284E-4 to a new imbalance of 3.507477711967816E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.03422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:50,048 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv134376301:81 , srv1466270808:83 , srv216076522:83 , srv333382645:83 , srv1025641673:84 , srv1047708174:84 , srv1145656401:84 , srv1265237307:84 , srv1350901850:84 , srv1366218875:84 , srv1485357301:84 , srv1547695204:84 , srv1659720864:84 , srv1676644993:84 , srv1724571676:84 , srv1756749426:84 , srv1877264562:84 , srv1884249536:84 , srv1909403136:84 , srv2034461299:84 , srv2076758004:84 , srv207988732:84 , srv2123131924:84 , srv284736998:84 , srv340793635:84 , srv413373908:84 , srv421052300:84 , srv467882627:84 , srv511489749:84 , srv545762369:84 , srv723155443:84 , srv914335485:84 , srv919773171:84 , srv947096351:84 , srv1014641875:85 , srv1035486884:85 , srv1100436802:85 , srv1128595809:85 , srv1129350791:85 , srv1174633534:85 , srv1207563177:85 , srv1372372792:85 , srv1389895123:85 , srv1396100411:85 , srv1396450700:85 , srv1407315895:85 , srv1458279216:85 , srv1488486767:85 , srv1528739707:85 , srv1550895362:85 , srv1569055217:85 , srv1607973024:85 , srv1627330011:85 , srv1639639329:85 , srv1660769851:85 , srv1701499704:85 , srv1723065474:85 , srv173318735:85 , srv1847610327:85 , srv1850795912:85 , srv1933022793:85 , srv1946808658:85 , srv1986318386:85 , srv2030279198:85 , srv2123167551:85 , srv22683166:85 , srv235172253:85 , srv270261744:85 , srv288133741:85 , srv356928100:85 , srv386155946:85 , srv420119911:85 , srv495163837:85 , srv509100539:85 , srv527551688:85 , srv576014396:85 , srv58735877:85 , srv627976338:85 , srv683988173:85 , srv757818973:85 , srv873534756:85 , srv8860800:85 , srv960085707:85 , srv962681472:85 , srv978268739:85 , srv1155181520:86 , srv1271028058:86 , srv1384945466:86 , srv1438889776:86 , srv1562050988:86 , srv1631852059:86 , srv1668297694:86 , srv255796183:86 , srv397897534:86 , srv61700590:86 , srv678574912:86 , srv717269091:86 , srv728977699:86 , srv772843714:86 , srv1096146226:611 }
2023-10-30 06:56:50,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:50,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1014641875=0, srv1207563177=11, srv2030279198=54, srv1100436802=5, srv947096351=96, srv1528739707=28, srv1756749426=45, srv235172253=62, srv1550895362=30, srv356928100=69, srv1128595809=6, srv511489749=78, srv1986318386=53, srv333382645=67, srv1850795912=47, srv1701499704=41, srv772843714=91, srv1438889776=23, srv1946808658=52, srv1466270808=25, srv58735877=82, srv1458279216=24, srv1631852059=35, srv1265237307=12, srv1035486884=2, srv1271028058=13, srv1174633534=10, srv509100539=77, srv717269091=87, srv1607973024=33, srv1659720864=37, srv270261744=64, srv576014396=81, srv1723065474=42, srv8860800=93, srv962681472=98, srv1627330011=34, srv173318735=44, srv340793635=68, srv627976338=84, srv2034461299=55, srv1396100411=20, srv1639639329=36, srv386155946=70, srv1547695204=29, srv678574912=85, srv1396450700=21, srv397897534=71, srv61700590=83, srv495163837=76, srv1660769851=38, srv1145656401=8, srv683988173=86, srv723155443=88, srv413373908=72, srv1350901850=15, srv1485357301=26, srv1562050988=31, srv1047708174=3, srv1389895123=19, srv1155181520=9, srv1884249536=49, srv1407315895=22, srv527551688=79, srv1569055217=32, srv2123131924=58, srv728977699=89, srv255796183=63, srv284736998=65, srv467882627=75, srv2076758004=56, srv1488486767=27, srv134376301=14, srv1909403136=50, srv1933022793=51, srv216076522=60, srv914335485=94, srv2123167551=59, srv420119911=73, srv1129350791=7, srv1668297694=39, srv22683166=61, srv1096146226=4, srv1025641673=1, srv1877264562=48, srv1384945466=18, srv207988732=57, srv288133741=66, srv1372372792=17, srv1847610327=46, srv919773171=95, srv960085707=97, srv873534756=92, srv978268739=99, srv1676644993=40, srv1366218875=16, srv1724571676=43, srv757818973=90, srv421052300=74, srv545762369=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:50,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:50,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 06:56:50,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 06:56:50,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 06:56:50,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 06:56:50,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 06:56:50,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 06:56:50,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 06:56:50,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 06:56:50,145 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:50,145 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 06:56:50,146 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.291811502441492E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 06:56:50,295 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 222 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 3.291811502441492E-5 to a new imbalance of 6.2211367805469E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:50,296 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1607973024:83 , srv1986318386:83 , srv2123167551:83 , srv22683166:83 , srv255796183:83 , srv397897534:83 , srv678574912:83 , srv914335485:83 , srv1014641875:84 , srv1025641673:84 , srv1047708174:84 , srv1100436802:84 , srv1128595809:84 , srv1129350791:84 , srv1145656401:84 , srv1155181520:84 , srv1174633534:84 , srv1207563177:84 , srv1265237307:84 , srv1271028058:84 , srv1350901850:84 , srv1366218875:84 , srv1372372792:84 , srv1384945466:84 , srv1389895123:84 , srv1396100411:84 , srv1396450700:84 , srv1407315895:84 , srv1438889776:84 , srv1458279216:84 , srv1466270808:84 , srv1485357301:84 , srv1488486767:84 , srv1528739707:84 , srv1547695204:84 , srv1550895362:84 , srv1562050988:84 , srv1569055217:84 , srv1627330011:84 , srv1631852059:84 , srv1639639329:84 , srv1659720864:84 , srv1660769851:84 , srv1668297694:84 , srv1676644993:84 , srv1701499704:84 , srv1723065474:84 , srv1724571676:84 , srv173318735:84 , srv1756749426:84 , srv1847610327:84 , srv1850795912:84 , srv1877264562:84 , srv1884249536:84 , srv1909403136:84 , srv1933022793:84 , srv1946808658:84 , srv2030279198:84 , srv2034461299:84 , srv207988732:84 , srv235172253:84 , srv270261744:84 , srv284736998:84 , srv288133741:84 , srv356928100:84 , srv386155946:84 , srv413373908:84 , srv420119911:84 , srv421052300:84 , srv467882627:84 , srv495163837:84 , srv509100539:84 , srv511489749:84 , srv527551688:84 , srv545762369:84 , srv576014396:84 , srv58735877:84 , srv61700590:84 , srv627976338:84 , srv683988173:84 , srv717269091:84 , srv723155443:84 , srv728977699:84 , srv757818973:84 , srv772843714:84 , srv873534756:84 , srv8860800:84 , srv919773171:84 , srv960085707:84 , srv962681472:84 , srv978268739:84 , srv1035486884:85 , srv134376301:85 , srv2076758004:85 , srv2123131924:85 , srv216076522:85 , srv333382645:85 , srv340793635:85 , srv947096351:85 , srv1096146226:684 }
2023-10-30 06:56:50,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:50,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1014641875=0, srv1207563177=11, srv2030279198=54, srv1100436802=5, srv947096351=96, srv1528739707=28, srv1756749426=45, srv235172253=62, srv1550895362=30, srv356928100=69, srv1128595809=6, srv511489749=78, srv1986318386=53, srv333382645=67, srv1850795912=47, srv1701499704=41, srv772843714=91, srv1438889776=23, srv1946808658=52, srv1466270808=25, srv58735877=82, srv1458279216=24, srv1631852059=35, srv1265237307=12, srv1035486884=2, srv1271028058=13, srv1174633534=10, srv509100539=77, srv717269091=87, srv1607973024=33, srv1659720864=37, srv270261744=64, srv576014396=81, srv1723065474=42, srv8860800=93, srv962681472=98, srv1627330011=34, srv173318735=44, srv340793635=68, srv627976338=84, srv2034461299=55, srv1396100411=20, srv1639639329=36, srv386155946=70, srv1547695204=29, srv678574912=85, srv1396450700=21, srv397897534=71, srv61700590=83, srv495163837=76, srv1660769851=38, srv1145656401=8, srv683988173=86, srv723155443=88, srv413373908=72, srv1350901850=15, srv1485357301=26, srv1562050988=31, srv1047708174=3, srv1389895123=19, srv1155181520=9, srv1884249536=49, srv1407315895=22, srv527551688=79, srv1569055217=32, srv2123131924=58, srv728977699=89, srv255796183=63, srv284736998=65, srv467882627=75, srv2076758004=56, srv1488486767=27, srv134376301=14, srv1909403136=50, srv1933022793=51, srv216076522=60, srv914335485=94, srv2123167551=59, srv420119911=73, srv1129350791=7, srv1668297694=39, srv22683166=61, srv1096146226=4, srv1025641673=1, srv1877264562=48, srv1384945466=18, srv207988732=57, srv288133741=66, srv1372372792=17, srv1847610327=46, srv919773171=95, srv960085707=97, srv873534756=92, srv978268739=99, srv1676644993=40, srv1366218875=16, srv1724571676=43, srv757818973=90, srv421052300=74, srv545762369=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:50,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 06:56:50,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 06:56:50,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 06:56:50,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 06:56:50,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 06:56:50,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 06:56:50,397 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:50,398 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1607973024:83 , srv1986318386:83 , srv2123167551:83 , srv22683166:83 , srv255796183:83 , srv397897534:83 , srv678574912:83 , srv914335485:83 , srv1014641875:84 , srv1025641673:84 , srv1047708174:84 , srv1100436802:84 , srv1128595809:84 , srv1129350791:84 , srv1145656401:84 , srv1155181520:84 , srv1174633534:84 , srv1207563177:84 , srv1265237307:84 , srv1271028058:84 , srv1350901850:84 , srv1366218875:84 , srv1372372792:84 , srv1384945466:84 , srv1389895123:84 , srv1396100411:84 , srv1396450700:84 , srv1407315895:84 , srv1438889776:84 , srv1458279216:84 , srv1466270808:84 , srv1485357301:84 , srv1488486767:84 , srv1528739707:84 , srv1547695204:84 , srv1550895362:84 , srv1562050988:84 , srv1569055217:84 , srv1627330011:84 , srv1631852059:84 , srv1639639329:84 , srv1659720864:84 , srv1660769851:84 , srv1668297694:84 , srv1676644993:84 , srv1701499704:84 , srv1723065474:84 , srv1724571676:84 , srv173318735:84 , srv1756749426:84 , srv1847610327:84 , srv1850795912:84 , srv1877264562:84 , srv1884249536:84 , srv1909403136:84 , srv1933022793:84 , srv1946808658:84 , srv2030279198:84 , srv2034461299:84 , srv207988732:84 , srv235172253:84 , srv270261744:84 , srv284736998:84 , srv288133741:84 , srv356928100:84 , srv386155946:84 , srv413373908:84 , srv420119911:84 , srv421052300:84 , srv467882627:84 , srv495163837:84 , srv509100539:84 , srv511489749:84 , srv527551688:84 , srv545762369:84 , srv576014396:84 , srv58735877:84 , srv61700590:84 , srv627976338:84 , srv683988173:84 , srv717269091:84 , srv723155443:84 , srv728977699:84 , srv757818973:84 , srv772843714:84 , srv873534756:84 , srv8860800:84 , srv919773171:84 , srv960085707:84 , srv962681472:84 , srv978268739:84 , srv1035486884:85 , srv134376301:85 , srv2076758004:85 , srv2123131924:85 , srv216076522:85 , srv333382645:85 , srv340793635:85 , srv947096351:85 , srv1096146226:684 }
2023-10-30 06:56:50,419 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 231), ProcessCount=167 (was 167), AvailableMemoryMB=2875 (was 3360)
2023-10-30 06:56:50,425 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=167, AvailableMemoryMB=2875
2023-10-30 06:56:50,426 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 06:56:50,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-30 06:56:50,438 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1049463866:84 , srv1071017204:84 , srv1108066337:84 , srv1117732077:84 , srv1143424757:84 , srv1270203414:84 , srv1397308898:84 , srv1401359199:84 , srv1472007792:84 , srv1510475480:84 , srv1690638883:84 , srv1872561450:84 , srv20757352:84 , srv2080066727:84 , srv378233455:84 , srv380771939:84 , srv397870200:84 , srv408221822:84 , srv410170388:84 , srv455521726:84 , srv474533690:84 , srv529544248:84 , srv555475737:84 , srv618282614:84 , srv716447020:84 , srv7267456:84 , srv744502518:84 , srv781311386:84 , srv933944093:84 , srv1261198220:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-30 06:56:50,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:56:50,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1143424757=4, srv410170388=19, srv1397308898=7, srv781311386=28, srv380771939=16, srv744502518=27, srv1261198220=5, srv555475737=23, srv529544248=22, srv20757352=13, srv2080066727=14, srv1049463866=0, srv618282614=24, srv716447020=25, srv1690638883=11, srv1401359199=8, srv1872561450=12, srv1270203414=6, srv1108066337=2, srv397870200=17, srv933944093=29, srv1510475480=10, srv378233455=15, srv408221822=18, srv1117732077=3, srv455521726=20, srv474533690=21, srv1472007792=9, srv1071017204=1, srv7267456=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:56:50,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:56:50,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:56:50,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:56:50,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:56:50,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:56:50,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:56:50,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:56:50,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:56:50,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-30 06:56:50,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1257839872193365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:56:50,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912589384500782, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1257839872193365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-30 06:58:50,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9616349 different iterations.  Found a solution that moves 1838 regions; Going from a computed imbalance of 0.9912589384500782 to a new imbalance of 4.2899836916600065E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6807407407407408, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:58:50,464 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1049463866:90 , srv1071017204:90 , srv1108066337:90 , srv1117732077:90 , srv1143424757:90 , srv1261198220:90 , srv1270203414:90 , srv1397308898:90 , srv1401359199:90 , srv1472007792:90 , srv1510475480:90 , srv1690638883:90 , srv1872561450:90 , srv20757352:90 , srv2080066727:90 , srv378233455:90 , srv380771939:90 , srv397870200:90 , srv408221822:90 , srv410170388:90 , srv455521726:90 , srv474533690:90 , srv529544248:90 , srv555475737:90 , srv618282614:90 , srv716447020:90 , srv7267456:90 , srv744502518:90 , srv781311386:90 , srv933944093:90 }
2023-10-30 06:58:50,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 06:58:50,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1143424757=4, srv410170388=19, srv1397308898=7, srv781311386=28, srv380771939=16, srv744502518=27, srv1261198220=5, srv555475737=23, srv529544248=22, srv20757352=13, srv2080066727=14, srv1049463866=0, srv618282614=24, srv716447020=25, srv1690638883=11, srv1401359199=8, srv1872561450=12, srv1270203414=6, srv1108066337=2, srv397870200=17, srv933944093=29, srv1510475480=10, srv378233455=15, srv408221822=18, srv1117732077=3, srv455521726=20, srv474533690=21, srv1472007792=9, srv1071017204=1, srv7267456=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 06:58:50,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 06:58:50,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 06:58:50,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 06:58:50,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 06:58:50,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-30 06:58:50,484 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 06:58:50,484 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1049463866:90 , srv1071017204:90 , srv1108066337:90 , srv1117732077:90 , srv1143424757:90 , srv1261198220:90 , srv1270203414:90 , srv1397308898:90 , srv1401359199:90 , srv1472007792:90 , srv1510475480:90 , srv1690638883:90 , srv1872561450:90 , srv20757352:90 , srv2080066727:90 , srv378233455:90 , srv380771939:90 , srv397870200:90 , srv408221822:90 , srv410170388:90 , srv455521726:90 , srv474533690:90 , srv529544248:90 , srv555475737:90 , srv618282614:90 , srv716447020:90 , srv7267456:90 , srv744502518:90 , srv781311386:90 , srv933944093:90 }
2023-10-30 06:58:50,498 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 231) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 167), AvailableMemoryMB=3058 (was 2875) - AvailableMemoryMB LEAK? -