2023-04-16 10:55:35,545 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-16 10:55:35,929 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-16 10:55:36,061 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-16 10:55:36,126 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-16 10:55:36,135 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-16 10:55:36,149 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=352, ProcessCount=169, AvailableMemoryMB=1383
2023-04-16 10:55:36,152 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-16 10:55:36,152 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-16 10:55:36,305 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022985155:84 , srv1039552166:84 , srv1047360756:84 , srv1070296653:84 , srv1075837582:84 , srv108788343:84 , srv1130607291:84 , srv1165701814:84 , srv118809234:84 , srv1204249123:84 , srv1267639803:84 , srv1271422312:84 , srv1316266241:84 , srv1334772227:84 , srv1358152833:84 , srv1377124728:84 , srv1385885959:84 , srv1397940549:84 , srv1400975719:84 , srv1422188526:84 , srv1422666789:84 , srv1427888004:84 , srv1460413217:84 , srv1466651793:84 , srv1469563289:84 , srv1475245885:84 , srv1485695102:84 , srv151970022:84 , srv1525008820:84 , srv152720620:84 , srv1534575136:84 , srv1537832612:84 , srv1547100254:84 , srv1579767532:84 , srv1586525400:84 , srv1662997961:84 , srv169701537:84 , srv1703377099:84 , srv1707653015:84 , srv1733271336:84 , srv1744820486:84 , srv1748996249:84 , srv1760631691:84 , srv1791391030:84 , srv1837395284:84 , srv1838535388:84 , srv1859381006:84 , srv1877531653:84 , srv1878344499:84 , srv1892686315:84 , srv1945000611:84 , srv1950338162:84 , srv1961474243:84 , srv1998881342:84 , srv2054511744:84 , srv2082243202:84 , srv2119708786:84 , srv2129303658:84 , srv2138275952:84 , srv216004935:84 , srv223395727:84 , srv230498777:84 , srv26425603:84 , srv26679695:84 , srv289807647:84 , srv299944818:84 , srv320308033:84 , srv353944556:84 , srv356826526:84 , srv413635619:84 , srv433067077:84 , srv434127117:84 , srv441598402:84 , srv490241483:84 , srv497657014:84 , srv514822272:84 , srv515722358:84 , srv524862846:84 , srv608456417:84 , srv632590028:84 , srv653489818:84 , srv685772361:84 , srv696481737:84 , srv707440532:84 , srv709600847:84 , srv729178219:84 , srv744348955:84 , srv765737200:84 , srv796424684:84 , srv807508032:84 , srv821177195:84 , srv854556851:84 , srv876430742:84 , srv89088649:84 , srv938843874:84 , srv976552146:84 , srv980353227:84 , srv989402043:84 , srv997795515:84 , srv854915681:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-16 10:55:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:55:36,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv230498777=61, srv26425603=62, srv320308033=66, srv1469563289=24, srv108788343=5, srv997795515=99, srv1760631691=42, srv216004935=59, srv1791391030=43, srv807508032=89, srv653489818=80, srv1316266241=12, srv707440532=83, srv854915681=92, srv709600847=84, srv1878344499=48, srv1267639803=10, srv685772361=81, srv524862846=77, srv1859381006=46, srv1397940549=17, srv976552146=96, srv1961474243=52, srv632590028=79, srv1838535388=45, srv1075837582=4, srv744348955=86, srv1534575136=30, srv980353227=97, srv1422188526=19, srv1707653015=38, srv289807647=64, srv1427888004=21, srv1422666789=20, srv1703377099=37, srv2138275952=58, srv353944556=67, srv515722358=76, srv1385885959=16, srv1586525400=34, srv490241483=73, srv118809234=8, srv1475245885=25, srv2129303658=57, srv1547100254=32, srv1525008820=28, srv1945000611=50, srv1837395284=44, srv696481737=82, srv796424684=88, srv1377124728=15, srv356826526=68, srv1271422312=11, srv765737200=87, srv1662997961=35, srv876430742=93, srv169701537=36, srv223395727=60, srv1130607291=6, srv1466651793=23, srv441598402=72, srv497657014=74, srv434127117=71, srv989402043=98, srv1358152833=14, srv854556851=91, srv1998881342=53, srv26679695=63, srv151970022=27, srv2054511744=54, srv938843874=95, srv729178219=85, srv608456417=78, srv152720620=29, srv1733271336=39, srv1877531653=47, srv1039552166=1, srv1892686315=49, srv1744820486=40, srv1022985155=0, srv89088649=94, srv1400975719=18, srv1485695102=26, srv2082243202=55, srv1460413217=22, srv1204249123=9, srv433067077=70, srv1950338162=51, srv413635619=69, srv1165701814=7, srv1047360756=2, srv1070296653=3, srv1334772227=13, srv1579767532=33, srv514822272=75, srv1537832612=31, srv1748996249=41, srv2119708786=56, srv299944818=65, srv821177195=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:55:36,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:55:36,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:55:36,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:55:36,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:55:36,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:55:36,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:55:36,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:55:36,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-16 10:55:36,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-16 10:55:36,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-16 10:55:36,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-16 10:55:36,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-16 10:55:36,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-16 10:55:36,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-16 10:55:36,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-16 10:55:36,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-16 10:55:36,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-16 10:55:36,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-16 10:55:36,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-16 10:55:36,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-16 10:55:36,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-16 10:55:36,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-16 10:55:36,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-16 10:55:36,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-16 10:55:36,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-16 10:55:36,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-16 10:55:36,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-16 10:55:36,717 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:36,718 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-16 10:55:36,718 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-16 10:55:37,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 562 ms to try 5000 different iterations.  Found a solution that moves 4671 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1782698988503061. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04193772662327406, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05123174170399335, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.519, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04193772662327406, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17408333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:37,086 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1334772227:82 , srv1791391030:82 , srv1047360756:83 , srv1130607291:83 , srv1397940549:83 , srv1422188526:83 , srv151970022:83 , srv1760631691:83 , srv1837395284:83 , srv413635619:83 , srv514822272:83 , srv744348955:83 , srv152720620:84 , srv1534575136:84 , srv2129303658:84 , srv216004935:84 , srv356826526:84 , srv433067077:84 , srv524862846:84 , srv89088649:84 , srv1070296653:85 , srv1165701814:85 , srv1204249123:85 , srv1422666789:85 , srv1427888004:85 , srv1485695102:85 , srv1537832612:85 , srv1547100254:85 , srv1586525400:85 , srv1703377099:85 , srv1748996249:85 , srv1838535388:85 , srv1961474243:85 , srv1998881342:85 , srv230498777:85 , srv26425603:85 , srv821177195:85 , srv980353227:85 , srv997795515:85 , srv118809234:86 , srv1271422312:86 , srv1358152833:86 , srv1400975719:86 , srv1460413217:86 , srv1525008820:86 , srv1662997961:86 , srv1892686315:86 , srv1945000611:86 , srv1950338162:86 , srv2138275952:86 , srv223395727:86 , srv299944818:86 , srv441598402:86 , srv608456417:86 , srv632590028:86 , srv685772361:86 , srv709600847:86 , srv807508032:86 , srv876430742:86 , srv938843874:86 , srv1075837582:87 , srv1469563289:87 , srv1475245885:87 , srv1579767532:87 , srv169701537:87 , srv2119708786:87 , srv26679695:87 , srv353944556:87 , srv696481737:87 , srv729178219:87 , srv765737200:87 , srv796424684:87 , srv989402043:87 , srv1022985155:88 , srv1039552166:88 , srv1466651793:88 , srv1707653015:88 , srv1733271336:88 , srv1859381006:88 , srv1877531653:88 , srv1878344499:88 , srv707440532:88 , srv854556851:88 , srv108788343:89 , srv1267639803:89 , srv1377124728:89 , srv1385885959:89 , srv1744820486:89 , srv2054511744:89 , srv2082243202:89 , srv320308033:89 , srv490241483:89 , srv497657014:89 , srv1316266241:90 , srv289807647:90 , srv653489818:91 , srv976552146:92 , srv434127117:93 , srv515722358:93 , srv854915681:463 }
2023-04-16 10:55:37,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:55:37,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv230498777=61, srv26425603=62, srv320308033=66, srv1469563289=24, srv108788343=5, srv997795515=99, srv1760631691=42, srv216004935=59, srv1791391030=43, srv807508032=89, srv653489818=80, srv1316266241=12, srv707440532=83, srv854915681=92, srv709600847=84, srv1878344499=48, srv1267639803=10, srv685772361=81, srv524862846=77, srv1859381006=46, srv1397940549=17, srv976552146=96, srv1961474243=52, srv632590028=79, srv1838535388=45, srv1075837582=4, srv744348955=86, srv1534575136=30, srv980353227=97, srv1422188526=19, srv1707653015=38, srv289807647=64, srv1427888004=21, srv1422666789=20, srv1703377099=37, srv2138275952=58, srv353944556=67, srv515722358=76, srv1385885959=16, srv1586525400=34, srv490241483=73, srv118809234=8, srv1475245885=25, srv2129303658=57, srv1547100254=32, srv1525008820=28, srv1945000611=50, srv1837395284=44, srv696481737=82, srv796424684=88, srv1377124728=15, srv356826526=68, srv1271422312=11, srv765737200=87, srv1662997961=35, srv876430742=93, srv169701537=36, srv223395727=60, srv1130607291=6, srv1466651793=23, srv441598402=72, srv497657014=74, srv434127117=71, srv989402043=98, srv1358152833=14, srv854556851=91, srv1998881342=53, srv26679695=63, srv151970022=27, srv2054511744=54, srv938843874=95, srv729178219=85, srv608456417=78, srv152720620=29, srv1733271336=39, srv1877531653=47, srv1039552166=1, srv1892686315=49, srv1744820486=40, srv1022985155=0, srv89088649=94, srv1400975719=18, srv1485695102=26, srv2082243202=55, srv1460413217=22, srv1204249123=9, srv433067077=70, srv1950338162=51, srv413635619=69, srv1165701814=7, srv1047360756=2, srv1070296653=3, srv1334772227=13, srv1579767532=33, srv514822272=75, srv1537832612=31, srv1748996249=41, srv2119708786=56, srv299944818=65, srv821177195=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:55:37,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:55:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:55:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:55:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:55:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:55:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:55:37,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:55:37,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-16 10:55:37,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-16 10:55:37,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-16 10:55:37,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-16 10:55:37,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-16 10:55:37,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-16 10:55:37,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-16 10:55:37,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-16 10:55:37,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-16 10:55:37,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-16 10:55:37,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-16 10:55:37,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-16 10:55:37,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04193772662327406, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05123174170399335, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04193772662327406, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17408333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:37,303 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-16 10:55:37,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1782371918092445, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04193772662327406, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05123174170399335, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04193772662327406, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17408333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-16 10:55:37,705 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 544 ms to try 5000 different iterations.  Found a solution that moves 2583 regions; Going from a computed imbalance of 0.1782371918092445 to a new imbalance of 0.014938698316451253. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02129666227177851); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02855282382877536, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.287, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02129666227177851); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:37,717 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv434127117:79 , srv515722358:81 , srv108788343:82 , srv1385885959:82 , srv1579767532:82 , srv1945000611:82 , srv2054511744:82 , srv289807647:82 , srv320308033:82 , srv653489818:82 , srv1022985155:83 , srv1267639803:83 , srv1707653015:83 , srv1878344499:83 , srv729178219:83 , srv976552146:83 , srv1316266241:84 , srv1377124728:84 , srv1466651793:84 , srv1744820486:84 , srv1877531653:84 , srv2082243202:84 , srv2119708786:84 , srv497657014:84 , srv632590028:84 , srv854556851:84 , srv989402043:84 , srv1039552166:85 , srv1271422312:85 , srv1475245885:85 , srv1586525400:85 , srv169701537:85 , srv1733271336:85 , srv1961474243:85 , srv223395727:85 , srv230498777:85 , srv26679695:85 , srv299944818:85 , srv353944556:85 , srv433067077:85 , srv490241483:85 , srv696481737:85 , srv707440532:85 , srv821177195:85 , srv980353227:85 , srv1075837582:86 , srv1204249123:86 , srv1358152833:86 , srv1400975719:86 , srv1427888004:86 , srv1485695102:86 , srv151970022:86 , srv1537832612:86 , srv1703377099:86 , srv1892686315:86 , srv2138275952:86 , srv216004935:86 , srv26425603:86 , srv441598402:86 , srv608456417:86 , srv685772361:86 , srv765737200:86 , srv807508032:86 , srv876430742:86 , srv89088649:86 , srv1165701814:87 , srv1469563289:87 , srv1547100254:87 , srv1748996249:87 , srv1950338162:87 , srv1998881342:87 , srv413635619:87 , srv709600847:87 , srv938843874:87 , srv1047360756:88 , srv1130607291:88 , srv118809234:88 , srv1334772227:88 , srv1422666789:88 , srv152720620:88 , srv1760631691:88 , srv1838535388:88 , srv356826526:88 , srv744348955:88 , srv1070296653:89 , srv1460413217:89 , srv1662997961:89 , srv2129303658:89 , srv1397940549:90 , srv1422188526:90 , srv1525008820:90 , srv1791391030:90 , srv1837395284:90 , srv1859381006:90 , srv524862846:90 , srv796424684:90 , srv997795515:90 , srv514822272:91 , srv1534575136:92 , srv854915681:500 }
2023-04-16 10:55:37,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:55:37,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv230498777=61, srv26425603=62, srv320308033=66, srv1469563289=24, srv108788343=5, srv997795515=99, srv1760631691=42, srv216004935=59, srv1791391030=43, srv807508032=89, srv653489818=80, srv1316266241=12, srv707440532=83, srv854915681=92, srv709600847=84, srv1878344499=48, srv1267639803=10, srv685772361=81, srv524862846=77, srv1859381006=46, srv1397940549=17, srv976552146=96, srv1961474243=52, srv632590028=79, srv1838535388=45, srv1075837582=4, srv744348955=86, srv1534575136=30, srv980353227=97, srv1422188526=19, srv1707653015=38, srv289807647=64, srv1427888004=21, srv1422666789=20, srv1703377099=37, srv2138275952=58, srv353944556=67, srv515722358=76, srv1385885959=16, srv1586525400=34, srv490241483=73, srv118809234=8, srv1475245885=25, srv2129303658=57, srv1547100254=32, srv1525008820=28, srv1945000611=50, srv1837395284=44, srv696481737=82, srv796424684=88, srv1377124728=15, srv356826526=68, srv1271422312=11, srv765737200=87, srv1662997961=35, srv876430742=93, srv169701537=36, srv223395727=60, srv1130607291=6, srv1466651793=23, srv441598402=72, srv497657014=74, srv434127117=71, srv989402043=98, srv1358152833=14, srv854556851=91, srv1998881342=53, srv26679695=63, srv151970022=27, srv2054511744=54, srv938843874=95, srv729178219=85, srv608456417=78, srv152720620=29, srv1733271336=39, srv1877531653=47, srv1039552166=1, srv1892686315=49, srv1744820486=40, srv1022985155=0, srv89088649=94, srv1400975719=18, srv1485695102=26, srv2082243202=55, srv1460413217=22, srv1204249123=9, srv433067077=70, srv1950338162=51, srv413635619=69, srv1165701814=7, srv1047360756=2, srv1070296653=3, srv1334772227=13, srv1579767532=33, srv514822272=75, srv1537832612=31, srv1748996249=41, srv2119708786=56, srv299944818=65, srv821177195=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:55:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:55:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:55:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:55:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:55:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:55:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:55:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:55:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-16 10:55:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-16 10:55:37,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-16 10:55:37,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-16 10:55:37,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-16 10:55:37,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-16 10:55:37,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-16 10:55:37,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-16 10:55:37,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-16 10:55:37,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-16 10:55:37,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-16 10:55:37,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-16 10:55:37,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-16 10:55:37,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-16 10:55:37,901 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02129666227177851); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02855282382877536, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02129666227177851); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:37,901 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-16 10:55:37,901 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014920611763879613, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02129666227177851); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02855282382877536, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02129666227177851); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-16 10:55:38,251 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 476 ms to try 5000 different iterations.  Found a solution that moves 937 regions; Going from a computed imbalance of 0.014920611763879613 to a new imbalance of 4.642776378248955E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005197196285794048); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006122578771996662); MoveCostFunction : (multiplier=7.0, imbalance=0.10411111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005197196285794048); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:38,253 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1859381006:80 , srv1525008820:81 , srv796424684:81 , srv1460413217:82 , srv1534575136:82 , srv976552146:82 , srv118809234:83 , srv1316266241:83 , srv1662997961:83 , srv490241483:83 , srv514822272:83 , srv515722358:83 , srv524862846:83 , srv997795515:83 , srv1039552166:84 , srv1070296653:84 , srv1397940549:84 , srv1422188526:84 , srv1422666789:84 , srv1469563289:84 , srv1744820486:84 , srv1837395284:84 , srv2129303658:84 , srv497657014:84 , srv653489818:84 , srv709600847:84 , srv765737200:84 , srv938843874:84 , srv1075837582:85 , srv1267639803:85 , srv1358152833:85 , srv1377124728:85 , srv1475245885:85 , srv152720620:85 , srv1547100254:85 , srv1791391030:85 , srv1838535388:85 , srv1892686315:85 , srv1950338162:85 , srv1998881342:85 , srv2082243202:85 , srv289807647:85 , srv353944556:85 , srv356826526:85 , srv707440532:85 , srv1022985155:86 , srv1047360756:86 , srv1130607291:86 , srv1165701814:86 , srv1400975719:86 , srv1466651793:86 , srv1485695102:86 , srv1537832612:86 , srv169701537:86 , srv1703377099:86 , srv1733271336:86 , srv1748996249:86 , srv1877531653:86 , srv1878344499:86 , srv2138275952:86 , srv223395727:86 , srv26679695:86 , srv299944818:86 , srv320308033:86 , srv434127117:86 , srv441598402:86 , srv608456417:86 , srv685772361:86 , srv696481737:86 , srv807508032:86 , srv854556851:86 , srv876430742:86 , srv108788343:87 , srv1204249123:87 , srv1271422312:87 , srv1385885959:87 , srv1427888004:87 , srv1586525400:87 , srv1707653015:87 , srv1760631691:87 , srv1961474243:87 , srv2119708786:87 , srv230498777:87 , srv26425603:87 , srv744348955:87 , srv821177195:87 , srv989402043:87 , srv1334772227:88 , srv1579767532:88 , srv2054511744:88 , srv216004935:88 , srv413635619:88 , srv632590028:88 , srv729178219:88 , srv89088649:88 , srv980353227:88 , srv151970022:89 , srv1945000611:89 , srv433067077:89 , srv854915681:541 }
2023-04-16 10:55:38,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:55:38,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv230498777=61, srv26425603=62, srv320308033=66, srv1469563289=24, srv108788343=5, srv997795515=99, srv1760631691=42, srv216004935=59, srv1791391030=43, srv807508032=89, srv653489818=80, srv1316266241=12, srv707440532=83, srv854915681=92, srv709600847=84, srv1878344499=48, srv1267639803=10, srv685772361=81, srv524862846=77, srv1859381006=46, srv1397940549=17, srv976552146=96, srv1961474243=52, srv632590028=79, srv1838535388=45, srv1075837582=4, srv744348955=86, srv1534575136=30, srv980353227=97, srv1422188526=19, srv1707653015=38, srv289807647=64, srv1427888004=21, srv1422666789=20, srv1703377099=37, srv2138275952=58, srv353944556=67, srv515722358=76, srv1385885959=16, srv1586525400=34, srv490241483=73, srv118809234=8, srv1475245885=25, srv2129303658=57, srv1547100254=32, srv1525008820=28, srv1945000611=50, srv1837395284=44, srv696481737=82, srv796424684=88, srv1377124728=15, srv356826526=68, srv1271422312=11, srv765737200=87, srv1662997961=35, srv876430742=93, srv169701537=36, srv223395727=60, srv1130607291=6, srv1466651793=23, srv441598402=72, srv497657014=74, srv434127117=71, srv989402043=98, srv1358152833=14, srv854556851=91, srv1998881342=53, srv26679695=63, srv151970022=27, srv2054511744=54, srv938843874=95, srv729178219=85, srv608456417=78, srv152720620=29, srv1733271336=39, srv1877531653=47, srv1039552166=1, srv1892686315=49, srv1744820486=40, srv1022985155=0, srv89088649=94, srv1400975719=18, srv1485695102=26, srv2082243202=55, srv1460413217=22, srv1204249123=9, srv433067077=70, srv1950338162=51, srv413635619=69, srv1165701814=7, srv1047360756=2, srv1070296653=3, srv1334772227=13, srv1579767532=33, srv514822272=75, srv1537832612=31, srv1748996249=41, srv2119708786=56, srv299944818=65, srv821177195=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:55:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:55:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:55:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:55:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:55:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:55:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-16 10:55:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-16 10:55:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-16 10:55:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-16 10:55:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-16 10:55:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-16 10:55:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-16 10:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-16 10:55:38,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-16 10:55:38,459 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005197196285794048); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006122578771996662); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005197196285794048); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:38,459 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-16 10:55:38,460 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.5771662359352653E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005197196285794048); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006122578771996662); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005197196285794048); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-16 10:55:38,820 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 510 ms to try 5000 different iterations.  Found a solution that moves 214 regions; Going from a computed imbalance of 4.5771662359352653E-4 to a new imbalance of 2.0054199479696702E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.023777777777777776); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:38,821 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1385885959:83 , srv169701537:83 , srv1733271336:83 , srv2054511744:83 , srv2119708786:83 , srv1039552166:84 , srv1070296653:84 , srv1075837582:84 , srv108788343:84 , srv1165701814:84 , srv118809234:84 , srv1204249123:84 , srv1316266241:84 , srv1334772227:84 , srv1377124728:84 , srv1400975719:84 , srv1422666789:84 , srv1427888004:84 , srv1466651793:84 , srv151970022:84 , srv1525008820:84 , srv1534575136:84 , srv1579767532:84 , srv1662997961:84 , srv1707653015:84 , srv1748996249:84 , srv1760631691:84 , srv1859381006:84 , srv1950338162:84 , srv1961474243:84 , srv2082243202:84 , srv2138275952:84 , srv216004935:84 , srv26679695:84 , srv413635619:84 , srv433067077:84 , srv441598402:84 , srv608456417:84 , srv632590028:84 , srv696481737:84 , srv707440532:84 , srv729178219:84 , srv744348955:84 , srv765737200:84 , srv796424684:84 , srv807508032:84 , srv854556851:84 , srv876430742:84 , srv89088649:84 , srv980353227:84 , srv989402043:84 , srv997795515:84 , srv1022985155:85 , srv1130607291:85 , srv1267639803:85 , srv1271422312:85 , srv1358152833:85 , srv1422188526:85 , srv1460413217:85 , srv1469563289:85 , srv1475245885:85 , srv1485695102:85 , srv152720620:85 , srv1547100254:85 , srv1586525400:85 , srv1703377099:85 , srv1744820486:85 , srv1791391030:85 , srv1837395284:85 , srv1838535388:85 , srv1877531653:85 , srv1878344499:85 , srv1892686315:85 , srv1945000611:85 , srv1998881342:85 , srv2129303658:85 , srv223395727:85 , srv230498777:85 , srv26425603:85 , srv289807647:85 , srv299944818:85 , srv320308033:85 , srv353944556:85 , srv356826526:85 , srv434127117:85 , srv490241483:85 , srv497657014:85 , srv514822272:85 , srv515722358:85 , srv653489818:85 , srv685772361:85 , srv709600847:85 , srv821177195:85 , srv938843874:85 , srv976552146:85 , srv1047360756:86 , srv1397940549:86 , srv1537832612:86 , srv524862846:86 , srv854915681:638 }
2023-04-16 10:55:38,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:55:38,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv230498777=61, srv26425603=62, srv320308033=66, srv1469563289=24, srv108788343=5, srv997795515=99, srv1760631691=42, srv216004935=59, srv1791391030=43, srv807508032=89, srv653489818=80, srv1316266241=12, srv707440532=83, srv854915681=92, srv709600847=84, srv1878344499=48, srv1267639803=10, srv685772361=81, srv524862846=77, srv1859381006=46, srv1397940549=17, srv976552146=96, srv1961474243=52, srv632590028=79, srv1838535388=45, srv1075837582=4, srv744348955=86, srv1534575136=30, srv980353227=97, srv1422188526=19, srv1707653015=38, srv289807647=64, srv1427888004=21, srv1422666789=20, srv1703377099=37, srv2138275952=58, srv353944556=67, srv515722358=76, srv1385885959=16, srv1586525400=34, srv490241483=73, srv118809234=8, srv1475245885=25, srv2129303658=57, srv1547100254=32, srv1525008820=28, srv1945000611=50, srv1837395284=44, srv696481737=82, srv796424684=88, srv1377124728=15, srv356826526=68, srv1271422312=11, srv765737200=87, srv1662997961=35, srv876430742=93, srv169701537=36, srv223395727=60, srv1130607291=6, srv1466651793=23, srv441598402=72, srv497657014=74, srv434127117=71, srv989402043=98, srv1358152833=14, srv854556851=91, srv1998881342=53, srv26679695=63, srv151970022=27, srv2054511744=54, srv938843874=95, srv729178219=85, srv608456417=78, srv152720620=29, srv1733271336=39, srv1877531653=47, srv1039552166=1, srv1892686315=49, srv1744820486=40, srv1022985155=0, srv89088649=94, srv1400975719=18, srv1485695102=26, srv2082243202=55, srv1460413217=22, srv1204249123=9, srv433067077=70, srv1950338162=51, srv413635619=69, srv1165701814=7, srv1047360756=2, srv1070296653=3, srv1334772227=13, srv1579767532=33, srv514822272=75, srv1537832612=31, srv1748996249=41, srv2119708786=56, srv299944818=65, srv821177195=90} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:55:38,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:55:38,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:55:38,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:55:38,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:55:38,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-16 10:55:38,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-16 10:55:38,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-16 10:55:38,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-16 10:55:38,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-16 10:55:38,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-16 10:55:38,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-16 10:55:38,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-16 10:55:39,007 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.8555739452468344E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:39,007 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1385885959:83 , srv169701537:83 , srv1733271336:83 , srv2054511744:83 , srv2119708786:83 , srv1039552166:84 , srv1070296653:84 , srv1075837582:84 , srv108788343:84 , srv1165701814:84 , srv118809234:84 , srv1204249123:84 , srv1316266241:84 , srv1334772227:84 , srv1377124728:84 , srv1400975719:84 , srv1422666789:84 , srv1427888004:84 , srv1466651793:84 , srv151970022:84 , srv1525008820:84 , srv1534575136:84 , srv1579767532:84 , srv1662997961:84 , srv1707653015:84 , srv1748996249:84 , srv1760631691:84 , srv1859381006:84 , srv1950338162:84 , srv1961474243:84 , srv2082243202:84 , srv2138275952:84 , srv216004935:84 , srv26679695:84 , srv413635619:84 , srv433067077:84 , srv441598402:84 , srv608456417:84 , srv632590028:84 , srv696481737:84 , srv707440532:84 , srv729178219:84 , srv744348955:84 , srv765737200:84 , srv796424684:84 , srv807508032:84 , srv854556851:84 , srv876430742:84 , srv89088649:84 , srv980353227:84 , srv989402043:84 , srv997795515:84 , srv1022985155:85 , srv1130607291:85 , srv1267639803:85 , srv1271422312:85 , srv1358152833:85 , srv1422188526:85 , srv1460413217:85 , srv1469563289:85 , srv1475245885:85 , srv1485695102:85 , srv152720620:85 , srv1547100254:85 , srv1586525400:85 , srv1703377099:85 , srv1744820486:85 , srv1791391030:85 , srv1837395284:85 , srv1838535388:85 , srv1877531653:85 , srv1878344499:85 , srv1892686315:85 , srv1945000611:85 , srv1998881342:85 , srv2129303658:85 , srv223395727:85 , srv230498777:85 , srv26425603:85 , srv289807647:85 , srv299944818:85 , srv320308033:85 , srv353944556:85 , srv356826526:85 , srv434127117:85 , srv490241483:85 , srv497657014:85 , srv514822272:85 , srv515722358:85 , srv653489818:85 , srv685772361:85 , srv709600847:85 , srv821177195:85 , srv938843874:85 , srv976552146:85 , srv1047360756:86 , srv1397940549:86 , srv1537832612:86 , srv524862846:86 , srv854915681:638 }
2023-04-16 10:55:39,047 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 352) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=928 (was 1383)
2023-04-16 10:55:39,068 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=169, AvailableMemoryMB=928
2023-04-16 10:55:39,069 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-16 10:55:39,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-16 10:55:39,082 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv121835711:84 , srv1310517551:84 , srv1368037369:84 , srv1404878035:84 , srv1478994997:84 , srv1495926102:84 , srv1569853393:84 , srv1589865588:84 , srv1799983104:84 , srv1908074495:84 , srv192925497:84 , srv1930910786:84 , srv1942798753:84 , srv1953824729:84 , srv1998591221:84 , srv2049972284:84 , srv2075887031:84 , srv241472667:84 , srv306710610:84 , srv366608684:84 , srv47783338:84 , srv547559418:84 , srv591479327:84 , srv725772322:84 , srv81890972:84 , srv850481698:84 , srv904372525:84 , srv909656905:84 , srv934607797:84 , srv124039123:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-16 10:55:39,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:55:39,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1908074495=10, srv934607797=29, srv1799983104=9, srv366608684=20, srv121835711=0, srv81890972=25, srv904372525=27, srv1495926102=6, srv1953824729=14, srv124039123=1, srv2075887031=17, srv909656905=28, srv725772322=24, srv47783338=21, srv547559418=22, srv1930910786=12, srv192925497=11, srv1310517551=2, srv1998591221=15, srv591479327=23, srv1569853393=7, srv2049972284=16, srv241472667=18, srv1942798753=13, srv1478994997=5, srv306710610=19, srv850481698=26, srv1404878035=4, srv1589865588=8, srv1368037369=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:55:39,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:55:39,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:55:39,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:55:39,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:55:39,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:55:39,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:55:39,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-16 10:55:39,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1111123063622275, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:55:39,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912543154513477, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1111123063622275, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-16 10:57:39,103 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6092337 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.9912543154513477 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:57:39,109 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv121835711:90 , srv124039123:90 , srv1310517551:90 , srv1368037369:90 , srv1404878035:90 , srv1478994997:90 , srv1495926102:90 , srv1569853393:90 , srv1589865588:90 , srv1799983104:90 , srv1908074495:90 , srv192925497:90 , srv1930910786:90 , srv1942798753:90 , srv1953824729:90 , srv1998591221:90 , srv2049972284:90 , srv2075887031:90 , srv241472667:90 , srv306710610:90 , srv366608684:90 , srv47783338:90 , srv547559418:90 , srv591479327:90 , srv725772322:90 , srv81890972:90 , srv850481698:90 , srv904372525:90 , srv909656905:90 , srv934607797:90 }
2023-04-16 10:57:39,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-16 10:57:39,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1908074495=10, srv934607797=29, srv1799983104=9, srv366608684=20, srv121835711=0, srv81890972=25, srv904372525=27, srv1495926102=6, srv1953824729=14, srv124039123=1, srv2075887031=17, srv909656905=28, srv725772322=24, srv47783338=21, srv547559418=22, srv1930910786=12, srv192925497=11, srv1310517551=2, srv1998591221=15, srv591479327=23, srv1569853393=7, srv2049972284=16, srv241472667=18, srv1942798753=13, srv1478994997=5, srv306710610=19, srv850481698=26, srv1404878035=4, srv1589865588=8, srv1368037369=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-16 10:57:39,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-16 10:57:39,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-16 10:57:39,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-16 10:57:39,126 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv121835711:90 , srv124039123:90 , srv1310517551:90 , srv1368037369:90 , srv1404878035:90 , srv1478994997:90 , srv1495926102:90 , srv1569853393:90 , srv1589865588:90 , srv1799983104:90 , srv1908074495:90 , srv192925497:90 , srv1930910786:90 , srv1942798753:90 , srv1953824729:90 , srv1998591221:90 , srv2049972284:90 , srv2075887031:90 , srv241472667:90 , srv306710610:90 , srv366608684:90 , srv47783338:90 , srv547559418:90 , srv591479327:90 , srv725772322:90 , srv81890972:90 , srv850481698:90 , srv904372525:90 , srv909656905:90 , srv934607797:90 }
2023-04-16 10:57:39,138 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 403), ProcessCount=169 (was 169), AvailableMemoryMB=859 (was 928)