2023-11-10 04:55:19,020 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-10 04:55:19,294 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-10 04:55:19,393 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-10 04:55:19,453 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-10 04:55:19,460 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-10 04:55:19,473 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=97, ProcessCount=167, AvailableMemoryMB=11668
2023-11-10 04:55:19,475 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-10 04:55:19,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-10 04:55:19,627 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1050957164:84 , srv1061114606:84 , srv1065116301:84 , srv1065380177:84 , srv1067891045:84 , srv1106661375:84 , srv112006988:84 , srv1123274613:84 , srv1158507794:84 , srv1172244853:84 , srv1192977772:84 , srv1219727200:84 , srv1225032611:84 , srv1277929774:84 , srv1301256056:84 , srv1310222895:84 , srv1317047942:84 , srv1326520821:84 , srv1335038451:84 , srv1426720457:84 , srv1449306615:84 , srv1472727458:84 , srv1495227927:84 , srv1495818277:84 , srv1497523553:84 , srv1540325911:84 , srv1573120894:84 , srv1585596745:84 , srv1595944908:84 , srv1609614768:84 , srv1646225143:84 , srv1648395809:84 , srv1693071580:84 , srv1698396388:84 , srv170500307:84 , srv1708206567:84 , srv172645955:84 , srv1766958157:84 , srv1814616752:84 , srv182286759:84 , srv1839286875:84 , srv1847750173:84 , srv1851940254:84 , srv1892771683:84 , srv1905243767:84 , srv1922785033:84 , srv1958476420:84 , srv1971011564:84 , srv1974441752:84 , srv1976858980:84 , srv1994666346:84 , srv2048024004:84 , srv2143281648:84 , srv226335303:84 , srv261307149:84 , srv27934587:84 , srv287812222:84 , srv289133660:84 , srv29498945:84 , srv314469700:84 , srv314694268:84 , srv320117486:84 , srv387350254:84 , srv397290083:84 , srv402843143:84 , srv4031722:84 , srv407520692:84 , srv410430328:84 , srv429780226:84 , srv449851295:84 , srv500031794:84 , srv504363656:84 , srv545039127:84 , srv579024937:84 , srv587356844:84 , srv600625577:84 , srv601734886:84 , srv653623006:84 , srv655214803:84 , srv665426794:84 , srv698317023:84 , srv719115478:84 , srv750774988:84 , srv757325123:84 , srv760764123:84 , srv773189026:84 , srv774755770:84 , srv783551628:84 , srv784672515:84 , srv785735848:84 , srv812613675:84 , srv828512916:84 , srv865203928:84 , srv890103043:84 , srv896265023:84 , srv900536017:84 , srv937323761:84 , srv950421905:84 , srv969248710:84 , srv1471185296:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-10 04:55:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1225032611=12, srv773189026=86, srv1976858980=50, srv600625577=76, srv1426720457=19, srv1585596745=28, srv1892771683=44, srv1495227927=23, srv1648395809=32, srv2048024004=52, srv4031722=66, srv1123274613=7, srv665426794=80, srv1540325911=26, srv774755770=87, srv579024937=74, srv320117486=62, srv828512916=92, srv1219727200=11, srv1609614768=30, srv890103043=94, srv950421905=98, srv112006988=6, srv1994666346=51, srv397290083=64, srv1335038451=18, srv287812222=57, srv289133660=58, srv1471185296=21, srv785735848=90, srv812613675=91, srv601734886=77, srv27934587=56, srv896265023=95, srv655214803=79, srv750774988=83, srv900536017=96, srv545039127=73, srv261307149=55, srv1317047942=16, srv314694268=61, srv783551628=88, srv1158507794=8, srv1847750173=42, srv937323761=97, srv587356844=75, srv653623006=78, srv29498945=59, srv698317023=81, srv784672515=89, srv1693071580=33, srv1172244853=9, srv1192977772=10, srv969248710=99, srv2143281648=53, srv1277929774=13, srv1301256056=14, srv1922785033=46, srv1106661375=5, srv1814616752=39, srv1839286875=41, srv865203928=93, srv1708206567=36, srv1065116301=2, srv449851295=70, srv182286759=40, srv1497523553=25, srv1050957164=0, srv1573120894=27, srv226335303=54, srv500031794=71, srv172645955=37, srv387350254=63, srv1067891045=4, srv1698396388=34, srv1974441752=49, srv1958476420=47, srv1061114606=1, srv1495818277=24, srv1971011564=48, srv410430328=68, srv719115478=82, srv314469700=60, srv757325123=84, srv170500307=35, srv1310222895=15, srv1905243767=45, srv1646225143=31, srv402843143=65, srv429780226=69, srv1851940254=43, srv1326520821=17, srv1766958157=38, srv1472727458=22, srv504363656=72, srv1065380177=3, srv1449306615=20, srv407520692=67, srv1595944908=29, srv760764123=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:19,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:19,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:19,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:19,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:19,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:19,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:19,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:19,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:19,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:19,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:19,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:19,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:19,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:19,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:19,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:19,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:19,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:19,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:19,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 04:55:19,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 04:55:19,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 04:55:19,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 04:55:19,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 04:55:19,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 04:55:19,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 04:55:19,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 04:55:19,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 04:55:19,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 04:55:19,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 04:55:19,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 04:55:19,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 04:55:19,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 04:55:19,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 04:55:19,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 04:55:19,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 04:55:19,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 04:55:19,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 04:55:19,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 04:55:19,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 04:55:19,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 04:55:19,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 04:55:19,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 04:55:19,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 04:55:19,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 04:55:19,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 04:55:19,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 04:55:19,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 04:55:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 04:55:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 04:55:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 04:55:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 04:55:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 04:55:20,042 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:20,043 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 04:55:20,043 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 04:55:20,755 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 960 ms to try 5000 different iterations.  Found a solution that moves 4666 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1810057485829189. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04276338178043703, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05813602996247662, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5184444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04276338178043703, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:20,782 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1326520821:82 , srv261307149:82 , srv289133660:82 , srv429780226:82 , srv579024937:82 , srv900536017:82 , srv1192977772:83 , srv1310222895:83 , srv1573120894:83 , srv1585596745:83 , srv1646225143:83 , srv1648395809:83 , srv182286759:83 , srv1958476420:83 , srv226335303:83 , srv402843143:83 , srv783551628:83 , srv828512916:83 , srv937323761:83 , srv1595944908:84 , srv170500307:84 , srv1922785033:84 , srv1976858980:84 , srv27934587:84 , srv314694268:84 , srv397290083:84 , srv545039127:84 , srv719115478:84 , srv1050957164:85 , srv1106661375:85 , srv1219727200:85 , srv1449306615:85 , srv1495227927:85 , srv1708206567:85 , srv1814616752:85 , srv1892771683:85 , srv1994666346:85 , srv29498945:85 , srv320117486:85 , srv665426794:85 , srv750774988:85 , srv757325123:85 , srv785735848:85 , srv812613675:85 , srv865203928:85 , srv950421905:85 , srv1061114606:86 , srv1065116301:86 , srv1065380177:86 , srv1317047942:86 , srv1335038451:86 , srv1540325911:86 , srv1609614768:86 , srv1698396388:86 , srv2048024004:86 , srv387350254:86 , srv4031722:86 , srv587356844:86 , srv600625577:86 , srv655214803:86 , srv896265023:86 , srv1158507794:87 , srv1225032611:87 , srv1426720457:87 , srv1495818277:87 , srv1497523553:87 , srv1905243767:87 , srv314469700:87 , srv407520692:87 , srv890103043:87 , srv969248710:87 , srv1766958157:88 , srv1839286875:88 , srv2143281648:88 , srv449851295:88 , srv500031794:88 , srv504363656:88 , srv760764123:88 , srv773189026:88 , srv784672515:88 , srv1123274613:89 , srv1172244853:89 , srv1301256056:89 , srv1472727458:89 , srv172645955:89 , srv1847750173:89 , srv1971011564:89 , srv287812222:89 , srv112006988:90 , srv1974441752:90 , srv410430328:90 , srv698317023:90 , srv1067891045:91 , srv1693071580:91 , srv601734886:92 , srv653623006:92 , srv774755770:92 , srv1277929774:95 , srv1851940254:96 , srv1471185296:470 }
2023-11-10 04:55:20,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:20,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1225032611=12, srv773189026=86, srv1976858980=50, srv600625577=76, srv1426720457=19, srv1585596745=28, srv1892771683=44, srv1495227927=23, srv1648395809=32, srv2048024004=52, srv4031722=66, srv1123274613=7, srv665426794=80, srv1540325911=26, srv774755770=87, srv579024937=74, srv320117486=62, srv828512916=92, srv1219727200=11, srv1609614768=30, srv890103043=94, srv950421905=98, srv112006988=6, srv1994666346=51, srv397290083=64, srv1335038451=18, srv287812222=57, srv289133660=58, srv1471185296=21, srv785735848=90, srv812613675=91, srv601734886=77, srv27934587=56, srv896265023=95, srv655214803=79, srv750774988=83, srv900536017=96, srv545039127=73, srv261307149=55, srv1317047942=16, srv314694268=61, srv783551628=88, srv1158507794=8, srv1847750173=42, srv937323761=97, srv587356844=75, srv653623006=78, srv29498945=59, srv698317023=81, srv784672515=89, srv1693071580=33, srv1172244853=9, srv1192977772=10, srv969248710=99, srv2143281648=53, srv1277929774=13, srv1301256056=14, srv1922785033=46, srv1106661375=5, srv1814616752=39, srv1839286875=41, srv865203928=93, srv1708206567=36, srv1065116301=2, srv449851295=70, srv182286759=40, srv1497523553=25, srv1050957164=0, srv1573120894=27, srv226335303=54, srv500031794=71, srv172645955=37, srv387350254=63, srv1067891045=4, srv1698396388=34, srv1974441752=49, srv1958476420=47, srv1061114606=1, srv1495818277=24, srv1971011564=48, srv410430328=68, srv719115478=82, srv314469700=60, srv757325123=84, srv170500307=35, srv1310222895=15, srv1905243767=45, srv1646225143=31, srv402843143=65, srv429780226=69, srv1851940254=43, srv1326520821=17, srv1766958157=38, srv1472727458=22, srv504363656=72, srv1065380177=3, srv1449306615=20, srv407520692=67, srv1595944908=29, srv760764123=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:20,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:20,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:20,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:20,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:20,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:20,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:20,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:20,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:20,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:20,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 04:55:20,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 04:55:20,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 04:55:20,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 04:55:20,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 04:55:20,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 04:55:20,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 04:55:20,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 04:55:20,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 04:55:20,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 04:55:20,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 04:55:20,999 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04276338178043703, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05813602996247662, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04276338178043703, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:20,999 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 04:55:20,999 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18097307655260558, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04276338178043703, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05813602996247662, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04276338178043703, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 04:55:21,272 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 425 ms to try 5000 different iterations.  Found a solution that moves 2639 regions; Going from a computed imbalance of 0.18097307655260558 to a new imbalance of 0.01579898852578937. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024747131173317647); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03755728882498412, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2932222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024747131173317647); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:21,282 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1851940254:75 , srv1277929774:77 , srv601734886:79 , srv172645955:80 , srv1067891045:81 , srv1693071580:81 , srv1974441752:81 , srv698317023:81 , srv1225032611:82 , srv287812222:82 , srv314469700:82 , srv410430328:82 , srv653623006:82 , srv112006988:83 , srv1172244853:83 , srv1426720457:83 , srv1472727458:83 , srv1839286875:83 , srv1847750173:83 , srv1905243767:83 , srv1971011564:83 , srv407520692:83 , srv1050957164:84 , srv1123274613:84 , srv1301256056:84 , srv1495818277:84 , srv1540325911:84 , srv1766958157:84 , srv2143281648:84 , srv504363656:84 , srv1065116301:85 , srv1158507794:85 , srv1317047942:85 , srv1609614768:85 , srv1892771683:85 , srv1994666346:85 , srv29498945:85 , srv760764123:85 , srv773189026:85 , srv774755770:85 , srv784672515:85 , srv865203928:85 , srv896265023:85 , srv969248710:85 , srv1061114606:86 , srv1106661375:86 , srv1310222895:86 , srv1335038451:86 , srv1497523553:86 , srv1595944908:86 , srv387350254:86 , srv397290083:86 , srv449851295:86 , srv500031794:86 , srv600625577:86 , srv757325123:86 , srv890103043:86 , srv1065380177:87 , srv1219727200:87 , srv1495227927:87 , srv1573120894:87 , srv1648395809:87 , srv1698396388:87 , srv1708206567:87 , srv2048024004:87 , srv27934587:87 , srv314694268:87 , srv320117486:87 , srv429780226:87 , srv545039127:87 , srv587356844:87 , srv750774988:87 , srv785735848:87 , srv950421905:87 , srv1449306615:88 , srv170500307:88 , srv182286759:88 , srv1958476420:88 , srv1976858980:88 , srv226335303:88 , srv289133660:88 , srv665426794:88 , srv783551628:88 , srv1326520821:89 , srv1585596745:89 , srv1646225143:89 , srv1922785033:89 , srv261307149:89 , srv4031722:89 , srv579024937:89 , srv655214803:89 , srv812613675:89 , srv1814616752:90 , srv719115478:90 , srv828512916:90 , srv900536017:90 , srv937323761:90 , srv1192977772:91 , srv402843143:91 , srv1471185296:524 }
2023-11-10 04:55:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:21,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1225032611=12, srv773189026=86, srv1976858980=50, srv600625577=76, srv1426720457=19, srv1585596745=28, srv1892771683=44, srv1495227927=23, srv1648395809=32, srv2048024004=52, srv4031722=66, srv1123274613=7, srv665426794=80, srv1540325911=26, srv774755770=87, srv579024937=74, srv320117486=62, srv828512916=92, srv1219727200=11, srv1609614768=30, srv890103043=94, srv950421905=98, srv112006988=6, srv1994666346=51, srv397290083=64, srv1335038451=18, srv287812222=57, srv289133660=58, srv1471185296=21, srv785735848=90, srv812613675=91, srv601734886=77, srv27934587=56, srv896265023=95, srv655214803=79, srv750774988=83, srv900536017=96, srv545039127=73, srv261307149=55, srv1317047942=16, srv314694268=61, srv783551628=88, srv1158507794=8, srv1847750173=42, srv937323761=97, srv587356844=75, srv653623006=78, srv29498945=59, srv698317023=81, srv784672515=89, srv1693071580=33, srv1172244853=9, srv1192977772=10, srv969248710=99, srv2143281648=53, srv1277929774=13, srv1301256056=14, srv1922785033=46, srv1106661375=5, srv1814616752=39, srv1839286875=41, srv865203928=93, srv1708206567=36, srv1065116301=2, srv449851295=70, srv182286759=40, srv1497523553=25, srv1050957164=0, srv1573120894=27, srv226335303=54, srv500031794=71, srv172645955=37, srv387350254=63, srv1067891045=4, srv1698396388=34, srv1974441752=49, srv1958476420=47, srv1061114606=1, srv1495818277=24, srv1971011564=48, srv410430328=68, srv719115478=82, srv314469700=60, srv757325123=84, srv170500307=35, srv1310222895=15, srv1905243767=45, srv1646225143=31, srv402843143=65, srv429780226=69, srv1851940254=43, srv1326520821=17, srv1766958157=38, srv1472727458=22, srv504363656=72, srv1065380177=3, srv1449306615=20, srv407520692=67, srv1595944908=29, srv760764123=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:21,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:21,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:21,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:21,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 04:55:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 04:55:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 04:55:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 04:55:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 04:55:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 04:55:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 04:55:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 04:55:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 04:55:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 04:55:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 04:55:21,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024747131173317647); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03755728882498412, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024747131173317647); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:21,425 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 04:55:21,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015780509852836775, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024747131173317647); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03755728882498412, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024747131173317647); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 04:55:21,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 996 regions; Going from a computed imbalance of 0.015780509852836775 to a new imbalance of 7.672168220416331E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008356682589892833); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006615968845984975); MoveCostFunction : (multiplier=7.0, imbalance=0.11066666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008356682589892833); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:21,752 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv774755770:81 , srv1814616752:82 , srv812613675:82 , srv1065380177:83 , srv1192977772:83 , srv1698396388:83 , srv2048024004:83 , srv402843143:83 , srv4031722:83 , srv449851295:83 , srv500031794:83 , srv587356844:83 , srv655214803:83 , srv719115478:83 , srv773189026:83 , srv112006988:84 , srv1123274613:84 , srv1497523553:84 , srv1976858980:84 , srv320117486:84 , srv665426794:84 , srv760764123:84 , srv784672515:84 , srv828512916:84 , srv950421905:84 , srv969248710:84 , srv1061114606:85 , srv1065116301:85 , srv1219727200:85 , srv1301256056:85 , srv1335038451:85 , srv1449306615:85 , srv1472727458:85 , srv1495227927:85 , srv1646225143:85 , srv1693071580:85 , srv170500307:85 , srv1766958157:85 , srv1971011564:85 , srv2143281648:85 , srv287812222:85 , srv387350254:85 , srv410430328:85 , srv653623006:85 , srv750774988:85 , srv890103043:85 , srv937323761:85 , srv1067891045:86 , srv1106661375:86 , srv1158507794:86 , srv1172244853:86 , srv1277929774:86 , srv1426720457:86 , srv1595944908:86 , srv1847750173:86 , srv1905243767:86 , srv1922785033:86 , srv1958476420:86 , srv226335303:86 , srv261307149:86 , srv27934587:86 , srv314694268:86 , srv504363656:86 , srv545039127:86 , srv601734886:86 , srv757325123:86 , srv785735848:86 , srv896265023:86 , srv900536017:86 , srv1310222895:87 , srv1326520821:87 , srv1540325911:87 , srv1573120894:87 , srv1585596745:87 , srv1609614768:87 , srv1708206567:87 , srv172645955:87 , srv182286759:87 , srv1839286875:87 , srv1851940254:87 , srv1892771683:87 , srv1974441752:87 , srv1994666346:87 , srv289133660:87 , srv29498945:87 , srv429780226:87 , srv579024937:87 , srv600625577:87 , srv698317023:87 , srv783551628:87 , srv865203928:87 , srv1317047942:88 , srv1495818277:88 , srv1648395809:88 , srv314469700:88 , srv397290083:88 , srv407520692:88 , srv1050957164:89 , srv1225032611:89 , srv1471185296:538 }
2023-11-10 04:55:21,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:21,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1225032611=12, srv773189026=86, srv1976858980=50, srv600625577=76, srv1426720457=19, srv1585596745=28, srv1892771683=44, srv1495227927=23, srv1648395809=32, srv2048024004=52, srv4031722=66, srv1123274613=7, srv665426794=80, srv1540325911=26, srv774755770=87, srv579024937=74, srv320117486=62, srv828512916=92, srv1219727200=11, srv1609614768=30, srv890103043=94, srv950421905=98, srv112006988=6, srv1994666346=51, srv397290083=64, srv1335038451=18, srv287812222=57, srv289133660=58, srv1471185296=21, srv785735848=90, srv812613675=91, srv601734886=77, srv27934587=56, srv896265023=95, srv655214803=79, srv750774988=83, srv900536017=96, srv545039127=73, srv261307149=55, srv1317047942=16, srv314694268=61, srv783551628=88, srv1158507794=8, srv1847750173=42, srv937323761=97, srv587356844=75, srv653623006=78, srv29498945=59, srv698317023=81, srv784672515=89, srv1693071580=33, srv1172244853=9, srv1192977772=10, srv969248710=99, srv2143281648=53, srv1277929774=13, srv1301256056=14, srv1922785033=46, srv1106661375=5, srv1814616752=39, srv1839286875=41, srv865203928=93, srv1708206567=36, srv1065116301=2, srv449851295=70, srv182286759=40, srv1497523553=25, srv1050957164=0, srv1573120894=27, srv226335303=54, srv500031794=71, srv172645955=37, srv387350254=63, srv1067891045=4, srv1698396388=34, srv1974441752=49, srv1958476420=47, srv1061114606=1, srv1495818277=24, srv1971011564=48, srv410430328=68, srv719115478=82, srv314469700=60, srv757325123=84, srv170500307=35, srv1310222895=15, srv1905243767=45, srv1646225143=31, srv402843143=65, srv429780226=69, srv1851940254=43, srv1326520821=17, srv1766958157=38, srv1472727458=22, srv504363656=72, srv1065380177=3, srv1449306615=20, srv407520692=67, srv1595944908=29, srv760764123=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 04:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 04:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 04:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 04:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 04:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 04:55:21,903 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008356682589892833); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006615968845984975); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008356682589892833); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:21,903 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 04:55:21,903 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.602426809803273E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008356682589892833); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006615968845984975); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008356682589892833); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 04:55:22,119 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 335 ms to try 5000 different iterations.  Found a solution that moves 299 regions; Going from a computed imbalance of 7.602426809803273E-4 to a new imbalance of 4.419357131706729E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=6.317058262388458E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03322222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=6.317058262388458E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:22,120 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1277929774:83 , srv1317047942:83 , srv1326520821:83 , srv1585596745:83 , srv1708206567:83 , srv600625577:83 , srv653623006:83 , srv937323761:83 , srv1050957164:84 , srv1067891045:84 , srv112006988:84 , srv1172244853:84 , srv1225032611:84 , srv1301256056:84 , srv1449306615:84 , srv1495818277:84 , srv1497523553:84 , srv1573120894:84 , srv1609614768:84 , srv1646225143:84 , srv170500307:84 , srv182286759:84 , srv1839286875:84 , srv1847750173:84 , srv1922785033:84 , srv1974441752:84 , srv226335303:84 , srv29498945:84 , srv314694268:84 , srv397290083:84 , srv4031722:84 , srv407520692:84 , srv504363656:84 , srv579024937:84 , srv698317023:84 , srv783551628:84 , srv785735848:84 , srv865203928:84 , srv890103043:84 , srv1061114606:85 , srv1106661375:85 , srv1123274613:85 , srv1158507794:85 , srv1219727200:85 , srv1335038451:85 , srv1472727458:85 , srv1495227927:85 , srv1540325911:85 , srv1648395809:85 , srv1698396388:85 , srv1766958157:85 , srv1814616752:85 , srv1851940254:85 , srv1905243767:85 , srv1958476420:85 , srv1971011564:85 , srv1994666346:85 , srv2143281648:85 , srv261307149:85 , srv289133660:85 , srv314469700:85 , srv387350254:85 , srv402843143:85 , srv410430328:85 , srv429780226:85 , srv449851295:85 , srv500031794:85 , srv545039127:85 , srv601734886:85 , srv655214803:85 , srv665426794:85 , srv750774988:85 , srv757325123:85 , srv760764123:85 , srv774755770:85 , srv784672515:85 , srv896265023:85 , srv900536017:85 , srv969248710:85 , srv1065116301:86 , srv1065380177:86 , srv1192977772:86 , srv1310222895:86 , srv1426720457:86 , srv1595944908:86 , srv1693071580:86 , srv172645955:86 , srv1892771683:86 , srv1976858980:86 , srv2048024004:86 , srv27934587:86 , srv287812222:86 , srv320117486:86 , srv587356844:86 , srv719115478:86 , srv773189026:86 , srv812613675:86 , srv828512916:86 , srv950421905:87 , srv1471185296:611 }
2023-11-10 04:55:22,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:22,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1225032611=12, srv773189026=86, srv1976858980=50, srv600625577=76, srv1426720457=19, srv1585596745=28, srv1892771683=44, srv1495227927=23, srv1648395809=32, srv2048024004=52, srv4031722=66, srv1123274613=7, srv665426794=80, srv1540325911=26, srv774755770=87, srv579024937=74, srv320117486=62, srv828512916=92, srv1219727200=11, srv1609614768=30, srv890103043=94, srv950421905=98, srv112006988=6, srv1994666346=51, srv397290083=64, srv1335038451=18, srv287812222=57, srv289133660=58, srv1471185296=21, srv785735848=90, srv812613675=91, srv601734886=77, srv27934587=56, srv896265023=95, srv655214803=79, srv750774988=83, srv900536017=96, srv545039127=73, srv261307149=55, srv1317047942=16, srv314694268=61, srv783551628=88, srv1158507794=8, srv1847750173=42, srv937323761=97, srv587356844=75, srv653623006=78, srv29498945=59, srv698317023=81, srv784672515=89, srv1693071580=33, srv1172244853=9, srv1192977772=10, srv969248710=99, srv2143281648=53, srv1277929774=13, srv1301256056=14, srv1922785033=46, srv1106661375=5, srv1814616752=39, srv1839286875=41, srv865203928=93, srv1708206567=36, srv1065116301=2, srv449851295=70, srv182286759=40, srv1497523553=25, srv1050957164=0, srv1573120894=27, srv226335303=54, srv500031794=71, srv172645955=37, srv387350254=63, srv1067891045=4, srv1698396388=34, srv1974441752=49, srv1958476420=47, srv1061114606=1, srv1495818277=24, srv1971011564=48, srv410430328=68, srv719115478=82, srv314469700=60, srv757325123=84, srv170500307=35, srv1310222895=15, srv1905243767=45, srv1646225143=31, srv402843143=65, srv429780226=69, srv1851940254=43, srv1326520821=17, srv1766958157=38, srv1472727458=22, srv504363656=72, srv1065380177=3, srv1449306615=20, srv407520692=67, srv1595944908=29, srv760764123=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:22,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:22,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 04:55:22,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 04:55:22,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 04:55:22,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 04:55:22,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 04:55:22,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 04:55:22,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=6.317058262388458E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=6.317058262388458E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:22,254 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 04:55:22,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.2099928568743555E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=6.317058262388458E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=6.317058262388458E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 04:55:22,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 324 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 4.2099928568743555E-5 to a new imbalance of 7.639834888070601E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:22,473 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1158507794:83 , srv1192977772:83 , srv1495818277:83 , srv1648395809:83 , srv1693071580:83 , srv1851940254:83 , srv1892771683:83 , srv1922785033:83 , srv27934587:83 , srv655214803:83 , srv719115478:83 , srv774755770:83 , srv828512916:83 , srv900536017:83 , srv950421905:83 , srv1050957164:84 , srv1061114606:84 , srv1065116301:84 , srv1065380177:84 , srv1067891045:84 , srv1106661375:84 , srv1123274613:84 , srv1172244853:84 , srv1219727200:84 , srv1225032611:84 , srv1301256056:84 , srv1310222895:84 , srv1317047942:84 , srv1335038451:84 , srv1426720457:84 , srv1449306615:84 , srv1472727458:84 , srv1495227927:84 , srv1540325911:84 , srv1585596745:84 , srv1595944908:84 , srv1609614768:84 , srv1708206567:84 , srv172645955:84 , srv1766958157:84 , srv1814616752:84 , srv182286759:84 , srv1839286875:84 , srv1847750173:84 , srv1958476420:84 , srv1971011564:84 , srv1974441752:84 , srv1976858980:84 , srv1994666346:84 , srv2048024004:84 , srv2143281648:84 , srv261307149:84 , srv287812222:84 , srv289133660:84 , srv314469700:84 , srv320117486:84 , srv387350254:84 , srv397290083:84 , srv402843143:84 , srv4031722:84 , srv407520692:84 , srv410430328:84 , srv449851295:84 , srv500031794:84 , srv504363656:84 , srv545039127:84 , srv579024937:84 , srv587356844:84 , srv600625577:84 , srv601734886:84 , srv653623006:84 , srv665426794:84 , srv698317023:84 , srv750774988:84 , srv757325123:84 , srv760764123:84 , srv773189026:84 , srv783551628:84 , srv784672515:84 , srv785735848:84 , srv812613675:84 , srv890103043:84 , srv896265023:84 , srv112006988:85 , srv1277929774:85 , srv1326520821:85 , srv1497523553:85 , srv1573120894:85 , srv1646225143:85 , srv1698396388:85 , srv170500307:85 , srv1905243767:85 , srv226335303:85 , srv29498945:85 , srv314694268:85 , srv429780226:85 , srv865203928:85 , srv937323761:85 , srv969248710:85 , srv1471185296:683 }
2023-11-10 04:55:22,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:22,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1225032611=12, srv773189026=86, srv1976858980=50, srv600625577=76, srv1426720457=19, srv1585596745=28, srv1892771683=44, srv1495227927=23, srv1648395809=32, srv2048024004=52, srv4031722=66, srv1123274613=7, srv665426794=80, srv1540325911=26, srv774755770=87, srv579024937=74, srv320117486=62, srv828512916=92, srv1219727200=11, srv1609614768=30, srv890103043=94, srv950421905=98, srv112006988=6, srv1994666346=51, srv397290083=64, srv1335038451=18, srv287812222=57, srv289133660=58, srv1471185296=21, srv785735848=90, srv812613675=91, srv601734886=77, srv27934587=56, srv896265023=95, srv655214803=79, srv750774988=83, srv900536017=96, srv545039127=73, srv261307149=55, srv1317047942=16, srv314694268=61, srv783551628=88, srv1158507794=8, srv1847750173=42, srv937323761=97, srv587356844=75, srv653623006=78, srv29498945=59, srv698317023=81, srv784672515=89, srv1693071580=33, srv1172244853=9, srv1192977772=10, srv969248710=99, srv2143281648=53, srv1277929774=13, srv1301256056=14, srv1922785033=46, srv1106661375=5, srv1814616752=39, srv1839286875=41, srv865203928=93, srv1708206567=36, srv1065116301=2, srv449851295=70, srv182286759=40, srv1497523553=25, srv1050957164=0, srv1573120894=27, srv226335303=54, srv500031794=71, srv172645955=37, srv387350254=63, srv1067891045=4, srv1698396388=34, srv1974441752=49, srv1958476420=47, srv1061114606=1, srv1495818277=24, srv1971011564=48, srv410430328=68, srv719115478=82, srv314469700=60, srv757325123=84, srv170500307=35, srv1310222895=15, srv1905243767=45, srv1646225143=31, srv402843143=65, srv429780226=69, srv1851940254=43, srv1326520821=17, srv1766958157=38, srv1472727458=22, srv504363656=72, srv1065380177=3, srv1449306615=20, srv407520692=67, srv1595944908=29, srv760764123=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:22,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:22,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:22,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 04:55:22,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 04:55:22,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 04:55:22,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 04:55:22,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 04:55:22,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 04:55:22,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 04:55:22,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 04:55:22,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 04:55:22,603 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:22,604 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1158507794:83 , srv1192977772:83 , srv1495818277:83 , srv1648395809:83 , srv1693071580:83 , srv1851940254:83 , srv1892771683:83 , srv1922785033:83 , srv27934587:83 , srv655214803:83 , srv719115478:83 , srv774755770:83 , srv828512916:83 , srv900536017:83 , srv950421905:83 , srv1050957164:84 , srv1061114606:84 , srv1065116301:84 , srv1065380177:84 , srv1067891045:84 , srv1106661375:84 , srv1123274613:84 , srv1172244853:84 , srv1219727200:84 , srv1225032611:84 , srv1301256056:84 , srv1310222895:84 , srv1317047942:84 , srv1335038451:84 , srv1426720457:84 , srv1449306615:84 , srv1472727458:84 , srv1495227927:84 , srv1540325911:84 , srv1585596745:84 , srv1595944908:84 , srv1609614768:84 , srv1708206567:84 , srv172645955:84 , srv1766958157:84 , srv1814616752:84 , srv182286759:84 , srv1839286875:84 , srv1847750173:84 , srv1958476420:84 , srv1971011564:84 , srv1974441752:84 , srv1976858980:84 , srv1994666346:84 , srv2048024004:84 , srv2143281648:84 , srv261307149:84 , srv287812222:84 , srv289133660:84 , srv314469700:84 , srv320117486:84 , srv387350254:84 , srv397290083:84 , srv402843143:84 , srv4031722:84 , srv407520692:84 , srv410430328:84 , srv449851295:84 , srv500031794:84 , srv504363656:84 , srv545039127:84 , srv579024937:84 , srv587356844:84 , srv600625577:84 , srv601734886:84 , srv653623006:84 , srv665426794:84 , srv698317023:84 , srv750774988:84 , srv757325123:84 , srv760764123:84 , srv773189026:84 , srv783551628:84 , srv784672515:84 , srv785735848:84 , srv812613675:84 , srv890103043:84 , srv896265023:84 , srv112006988:85 , srv1277929774:85 , srv1326520821:85 , srv1497523553:85 , srv1573120894:85 , srv1646225143:85 , srv1698396388:85 , srv170500307:85 , srv1905243767:85 , srv226335303:85 , srv29498945:85 , srv314694268:85 , srv429780226:85 , srv865203928:85 , srv937323761:85 , srv969248710:85 , srv1471185296:683 }
2023-11-10 04:55:22,637 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 97) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=11133 (was 11668)
2023-11-10 04:55:22,644 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=167, AvailableMemoryMB=11133
2023-11-10 04:55:22,645 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-10 04:55:22,646 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-10 04:55:22,658 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006569310:84 , srv1006761840:84 , srv1159650578:84 , srv1171078088:84 , srv1295392530:84 , srv1317200153:84 , srv1329400857:84 , srv1364534412:84 , srv14433833:84 , srv1487446679:84 , srv1503414372:84 , srv164992397:84 , srv1665450135:84 , srv1770286162:84 , srv1774730829:84 , srv1777508811:84 , srv1833785481:84 , srv2081069356:84 , srv419424804:84 , srv539157031:84 , srv601911657:84 , srv617606017:84 , srv622724634:84 , srv658707647:84 , srv78072103:84 , srv812792739:84 , srv860373853:84 , srv867554428:84 , srv93852001:84 , srv326083866:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-10 04:55:22,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:55:22,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1329400857=6, srv1770286162=13, srv93852001=29, srv622724634=23, srv860373853=27, srv1503414372=10, srv164992397=11, srv326083866=18, srv812792739=26, srv1777508811=15, srv1833785481=16, srv419424804=19, srv78072103=25, srv14433833=8, srv1006569310=0, srv1006761840=1, srv1295392530=4, srv867554428=28, srv1317200153=5, srv1774730829=14, srv2081069356=17, srv1159650578=2, srv539157031=20, srv1171078088=3, srv1364534412=7, srv1665450135=12, srv601911657=21, srv1487446679=9, srv617606017=22, srv658707647=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:55:22,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:55:22,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:55:22,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:55:22,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:55:22,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:55:22,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-10 04:55:22,701 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.106634590984424, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:55:22,701 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912529045378532, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.106634590984424, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-10 04:57:22,680 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6427844 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912529045378532 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:57:22,689 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1006569310:90 , srv1006761840:90 , srv1159650578:90 , srv1171078088:90 , srv1295392530:90 , srv1317200153:90 , srv1329400857:90 , srv1364534412:90 , srv14433833:90 , srv1487446679:90 , srv1503414372:90 , srv164992397:90 , srv1665450135:90 , srv1770286162:90 , srv1774730829:90 , srv1777508811:90 , srv1833785481:90 , srv2081069356:90 , srv326083866:90 , srv419424804:90 , srv539157031:90 , srv601911657:90 , srv617606017:90 , srv622724634:90 , srv658707647:90 , srv78072103:90 , srv812792739:90 , srv860373853:90 , srv867554428:90 , srv93852001:90 }
2023-11-10 04:57:22,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 04:57:22,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1329400857=6, srv1770286162=13, srv93852001=29, srv622724634=23, srv860373853=27, srv1503414372=10, srv164992397=11, srv326083866=18, srv812792739=26, srv1777508811=15, srv1833785481=16, srv419424804=19, srv78072103=25, srv14433833=8, srv1006569310=0, srv1006761840=1, srv1295392530=4, srv867554428=28, srv1317200153=5, srv1774730829=14, srv2081069356=17, srv1159650578=2, srv539157031=20, srv1171078088=3, srv1364534412=7, srv1665450135=12, srv601911657=21, srv1487446679=9, srv617606017=22, srv658707647=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 04:57:22,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 04:57:22,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 04:57:22,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-10 04:57:22,715 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 04:57:22,715 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1006569310:90 , srv1006761840:90 , srv1159650578:90 , srv1171078088:90 , srv1295392530:90 , srv1317200153:90 , srv1329400857:90 , srv1364534412:90 , srv14433833:90 , srv1487446679:90 , srv1503414372:90 , srv164992397:90 , srv1665450135:90 , srv1770286162:90 , srv1774730829:90 , srv1777508811:90 , srv1833785481:90 , srv2081069356:90 , srv326083866:90 , srv419424804:90 , srv539157031:90 , srv601911657:90 , srv617606017:90 , srv622724634:90 , srv658707647:90 , srv78072103:90 , srv812792739:90 , srv860373853:90 , srv867554428:90 , srv93852001:90 }
2023-11-10 04:57:22,733 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 129) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=11443 (was 11133) - AvailableMemoryMB LEAK? -