2023-10-20 11:55:29,392 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-20 11:55:29,638 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-20 11:55:29,729 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-20 11:55:29,782 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-20 11:55:29,788 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-20 11:55:29,800 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=486, ProcessCount=180, AvailableMemoryMB=1898
2023-10-20 11:55:29,802 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-20 11:55:29,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-20 11:55:29,929 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005386:84 , srv1020746671:84 , srv1043077925:84 , srv1082816890:84 , srv1105172977:84 , srv1145362209:84 , srv1165602186:84 , srv1176418961:84 , srv118117866:84 , srv1194431322:84 , srv1200910358:84 , srv1209767800:84 , srv1214632405:84 , srv1229054149:84 , srv1230578951:84 , srv1255886435:84 , srv1261102954:84 , srv1272541005:84 , srv1284917075:84 , srv1296836284:84 , srv1297792186:84 , srv1323692279:84 , srv1325133790:84 , srv1389989401:84 , srv1391203058:84 , srv1430847048:84 , srv1447850356:84 , srv1472669236:84 , srv1485504651:84 , srv1504420585:84 , srv1518720623:84 , srv1544029943:84 , srv1545876994:84 , srv1603599642:84 , srv1605592115:84 , srv1621794930:84 , srv1709380924:84 , srv1730592114:84 , srv1758382782:84 , srv1784893692:84 , srv1803711376:84 , srv1834684709:84 , srv1841535591:84 , srv1841827780:84 , srv1867700043:84 , srv1867913518:84 , srv1877240240:84 , srv1877586125:84 , srv1891053887:84 , srv1892712025:84 , srv1919859518:84 , srv1937719266:84 , srv1944069171:84 , srv1976789418:84 , srv2016134295:84 , srv2100694383:84 , srv2105843258:84 , srv2126928881:84 , srv213829581:84 , srv2138666112:84 , srv21760227:84 , srv309652211:84 , srv322990566:84 , srv329416308:84 , srv345508539:84 , srv38500349:84 , srv385636729:84 , srv401837180:84 , srv433054728:84 , srv447237505:84 , srv45294852:84 , srv46501905:84 , srv466196357:84 , srv483539737:84 , srv509892249:84 , srv584783502:84 , srv640420210:84 , srv646950163:84 , srv650044006:84 , srv66344832:84 , srv693859825:84 , srv699157541:84 , srv700308128:84 , srv732357588:84 , srv756486782:84 , srv756642576:84 , srv80935958:84 , srv810668657:84 , srv838181915:84 , srv838210662:84 , srv855788454:84 , srv875286183:84 , srv893318005:84 , srv912173926:84 , srv919272965:84 , srv926028981:84 , srv934525165:84 , srv958580036:84 , srv970149288:84 , srv537945806:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-20 11:55:29,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:29,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv433054728=68, srv1105172977=4, srv1194431322=9, srv1284917075=18, srv1545876994=32, srv401837180=67, srv838210662=90, srv1296836284=19, srv810668657=88, srv1472669236=27, srv38500349=65, srv1261102954=16, srv1485504651=28, srv1043077925=2, srv1297792186=20, srv926028981=96, srv1020746671=1, srv537945806=75, srv2126928881=57, srv46501905=71, srv1391203058=24, srv646950163=78, srv1877586125=47, srv509892249=74, srv329416308=63, srv385636729=66, srv1709380924=36, srv1976789418=53, srv1145362209=5, srv1255886435=15, srv1841827780=43, srv756486782=85, srv1005386=0, srv447237505=69, srv45294852=70, srv958580036=98, srv756642576=86, srv912173926=94, srv693859825=81, srv893318005=93, srv1229054149=13, srv1803711376=40, srv1784893692=39, srv1200910358=10, srv466196357=72, srv970149288=99, srv1176418961=7, srv66344832=80, srv1323692279=21, srv855788454=91, srv1082816890=3, srv1605592115=34, srv1214632405=12, srv322990566=62, srv1937719266=51, srv1230578951=14, srv650044006=79, srv1209767800=11, srv1730592114=37, srv1891053887=48, srv1165602186=6, srv1544029943=31, srv1389989401=23, srv934525165=97, srv700308128=83, srv345508539=64, srv1518720623=30, srv483539737=73, srv2016134295=54, srv2138666112=59, srv1504420585=29, srv1892712025=49, srv875286183=92, srv1603599642=33, srv309652211=61, srv838181915=89, srv1325133790=22, srv1867700043=44, srv2105843258=56, srv80935958=87, srv699157541=82, srv1834684709=41, srv640420210=77, srv1919859518=50, srv919272965=95, srv1621794930=35, srv1447850356=26, srv584783502=76, srv2100694383=55, srv1867913518=45, srv732357588=84, srv21760227=60, srv213829581=58, srv1430847048=25, srv1758382782=38, srv118117866=8, srv1877240240=46, srv1272541005=17, srv1944069171=52, srv1841535591=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-20 11:55:30,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-20 11:55:30,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-20 11:55:30,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-20 11:55:30,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-20 11:55:30,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-20 11:55:30,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-20 11:55:30,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-20 11:55:30,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-20 11:55:30,572 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:30,573 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-20 11:55:30,573 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-20 11:55:31,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 954 ms to try 5000 different iterations.  Found a solution that moves 4693 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17825316543249153. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04071471467444324, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05878874656584702, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5214444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04071471467444324, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17291666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:31,018 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv447237505:81 , srv1485504651:82 , srv21760227:82 , srv646950163:82 , srv838181915:82 , srv934525165:82 , srv1391203058:83 , srv1504420585:83 , srv1944069171:83 , srv732357588:83 , srv893318005:83 , srv912173926:83 , srv1020746671:84 , srv1229054149:84 , srv1297792186:84 , srv1323692279:84 , srv1603599642:84 , srv2105843258:84 , srv309652211:84 , srv345508539:84 , srv640420210:84 , srv66344832:84 , srv756486782:84 , srv875286183:84 , srv1261102954:85 , srv1430847048:85 , srv1518720623:85 , srv1709380924:85 , srv1976789418:85 , srv322990566:85 , srv38500349:85 , srv433054728:85 , srv466196357:85 , srv693859825:85 , srv700308128:85 , srv1043077925:86 , srv1145362209:86 , srv1165602186:86 , srv1176418961:86 , srv118117866:86 , srv1214632405:86 , srv1230578951:86 , srv1447850356:86 , srv1544029943:86 , srv1803711376:86 , srv1892712025:86 , srv1919859518:86 , srv385636729:86 , srv401837180:86 , srv855788454:86 , srv958580036:86 , srv970149288:86 , srv1200910358:87 , srv1272541005:87 , srv1325133790:87 , srv1389989401:87 , srv1730592114:87 , srv1758382782:87 , srv1841827780:87 , srv1867700043:87 , srv1877240240:87 , srv1891053887:87 , srv1937719266:87 , srv213829581:87 , srv2138666112:87 , srv329416308:87 , srv756642576:87 , srv80935958:87 , srv926028981:87 , srv1082816890:88 , srv1194431322:88 , srv1284917075:88 , srv1296836284:88 , srv1605592115:88 , srv1867913518:88 , srv46501905:88 , srv483539737:88 , srv650044006:88 , srv919272965:88 , srv1105172977:89 , srv1209767800:89 , srv1255886435:89 , srv1834684709:89 , srv1877586125:89 , srv2016134295:89 , srv2100694383:89 , srv699157541:89 , srv810668657:89 , srv838210662:89 , srv1005386:90 , srv1545876994:90 , srv1841535591:90 , srv2126928881:90 , srv45294852:90 , srv509892249:90 , srv584783502:90 , srv1784893692:91 , srv1472669236:92 , srv1621794930:92 , srv537945806:452 }
2023-10-20 11:55:31,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:31,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv433054728=68, srv1105172977=4, srv1194431322=9, srv1284917075=18, srv1545876994=32, srv401837180=67, srv838210662=90, srv1296836284=19, srv810668657=88, srv1472669236=27, srv38500349=65, srv1261102954=16, srv1485504651=28, srv1043077925=2, srv1297792186=20, srv926028981=96, srv1020746671=1, srv537945806=75, srv2126928881=57, srv46501905=71, srv1391203058=24, srv646950163=78, srv1877586125=47, srv509892249=74, srv329416308=63, srv385636729=66, srv1709380924=36, srv1976789418=53, srv1145362209=5, srv1255886435=15, srv1841827780=43, srv756486782=85, srv1005386=0, srv447237505=69, srv45294852=70, srv958580036=98, srv756642576=86, srv912173926=94, srv693859825=81, srv893318005=93, srv1229054149=13, srv1803711376=40, srv1784893692=39, srv1200910358=10, srv466196357=72, srv970149288=99, srv1176418961=7, srv66344832=80, srv1323692279=21, srv855788454=91, srv1082816890=3, srv1605592115=34, srv1214632405=12, srv322990566=62, srv1937719266=51, srv1230578951=14, srv650044006=79, srv1209767800=11, srv1730592114=37, srv1891053887=48, srv1165602186=6, srv1544029943=31, srv1389989401=23, srv934525165=97, srv700308128=83, srv345508539=64, srv1518720623=30, srv483539737=73, srv2016134295=54, srv2138666112=59, srv1504420585=29, srv1892712025=49, srv875286183=92, srv1603599642=33, srv309652211=61, srv838181915=89, srv1325133790=22, srv1867700043=44, srv2105843258=56, srv80935958=87, srv699157541=82, srv1834684709=41, srv640420210=77, srv1919859518=50, srv919272965=95, srv1621794930=35, srv1447850356=26, srv584783502=76, srv2100694383=55, srv1867913518=45, srv732357588=84, srv21760227=60, srv213829581=58, srv1430847048=25, srv1758382782=38, srv118117866=8, srv1877240240=46, srv1272541005=17, srv1944069171=52, srv1841535591=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:31,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:31,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-20 11:55:31,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-20 11:55:31,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-20 11:55:31,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-20 11:55:31,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-20 11:55:31,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-20 11:55:31,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-20 11:55:31,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-20 11:55:31,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-20 11:55:31,199 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04071471467444324, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05878874656584702, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04071471467444324, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17291666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:31,199 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-20 11:55:31,199 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1782203043441374, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04071471467444324, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05878874656584702, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04071471467444324, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17291666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-20 11:55:31,455 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 372 ms to try 5000 different iterations.  Found a solution that moves 2692 regions; Going from a computed imbalance of 0.1782203043441374 to a new imbalance of 0.015293372862950532. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021825299167504923); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036609995997793736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2991111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021825299167504923); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04833333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:31,466 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1472669236:79 , srv1784893692:79 , srv1621794930:80 , srv2126928881:80 , srv1005386:81 , srv1545876994:81 , srv1841535591:81 , srv2100694383:81 , srv1105172977:82 , srv1209767800:82 , srv1877586125:82 , srv2016134295:82 , srv45294852:82 , srv509892249:82 , srv584783502:82 , srv1255886435:83 , srv1834684709:83 , srv1841827780:83 , srv1867700043:83 , srv2138666112:83 , srv650044006:83 , srv838210662:83 , srv919272965:83 , srv1082816890:84 , srv1200910358:84 , srv1214632405:84 , srv1605592115:84 , srv483539737:84 , srv699157541:84 , srv810668657:84 , srv1145362209:85 , srv118117866:85 , srv1194431322:85 , srv1296836284:85 , srv1389989401:85 , srv1518720623:85 , srv1758382782:85 , srv1877240240:85 , srv1891053887:85 , srv1976789418:85 , srv322990566:85 , srv329416308:85 , srv385636729:85 , srv401837180:85 , srv756642576:85 , srv80935958:85 , srv970149288:85 , srv1020746671:86 , srv1043077925:86 , srv1230578951:86 , srv1272541005:86 , srv1284917075:86 , srv1447850356:86 , srv1544029943:86 , srv1803711376:86 , srv1919859518:86 , srv213829581:86 , srv38500349:86 , srv46501905:86 , srv693859825:86 , srv1165602186:87 , srv1325133790:87 , srv1391203058:87 , srv1430847048:87 , srv1603599642:87 , srv1892712025:87 , srv1937719266:87 , srv2105843258:87 , srv640420210:87 , srv1176418961:88 , srv1323692279:88 , srv1709380924:88 , srv1730592114:88 , srv1867913518:88 , srv309652211:88 , srv433054728:88 , srv466196357:88 , srv700308128:88 , srv756486782:88 , srv855788454:88 , srv875286183:88 , srv958580036:88 , srv1229054149:89 , srv1261102954:89 , srv345508539:89 , srv646950163:89 , srv66344832:89 , srv732357588:89 , srv838181915:89 , srv926028981:89 , srv934525165:89 , srv1297792186:90 , srv1485504651:90 , srv447237505:90 , srv893318005:90 , srv1504420585:91 , srv1944069171:91 , srv912173926:91 , srv21760227:92 , srv537945806:516 }
2023-10-20 11:55:31,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:31,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv433054728=68, srv1105172977=4, srv1194431322=9, srv1284917075=18, srv1545876994=32, srv401837180=67, srv838210662=90, srv1296836284=19, srv810668657=88, srv1472669236=27, srv38500349=65, srv1261102954=16, srv1485504651=28, srv1043077925=2, srv1297792186=20, srv926028981=96, srv1020746671=1, srv537945806=75, srv2126928881=57, srv46501905=71, srv1391203058=24, srv646950163=78, srv1877586125=47, srv509892249=74, srv329416308=63, srv385636729=66, srv1709380924=36, srv1976789418=53, srv1145362209=5, srv1255886435=15, srv1841827780=43, srv756486782=85, srv1005386=0, srv447237505=69, srv45294852=70, srv958580036=98, srv756642576=86, srv912173926=94, srv693859825=81, srv893318005=93, srv1229054149=13, srv1803711376=40, srv1784893692=39, srv1200910358=10, srv466196357=72, srv970149288=99, srv1176418961=7, srv66344832=80, srv1323692279=21, srv855788454=91, srv1082816890=3, srv1605592115=34, srv1214632405=12, srv322990566=62, srv1937719266=51, srv1230578951=14, srv650044006=79, srv1209767800=11, srv1730592114=37, srv1891053887=48, srv1165602186=6, srv1544029943=31, srv1389989401=23, srv934525165=97, srv700308128=83, srv345508539=64, srv1518720623=30, srv483539737=73, srv2016134295=54, srv2138666112=59, srv1504420585=29, srv1892712025=49, srv875286183=92, srv1603599642=33, srv309652211=61, srv838181915=89, srv1325133790=22, srv1867700043=44, srv2105843258=56, srv80935958=87, srv699157541=82, srv1834684709=41, srv640420210=77, srv1919859518=50, srv919272965=95, srv1621794930=35, srv1447850356=26, srv584783502=76, srv2100694383=55, srv1867913518=45, srv732357588=84, srv21760227=60, srv213829581=58, srv1430847048=25, srv1758382782=38, srv118117866=8, srv1877240240=46, srv1272541005=17, srv1944069171=52, srv1841535591=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:31,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:31,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:31,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-20 11:55:31,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-20 11:55:31,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-20 11:55:31,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-20 11:55:31,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-20 11:55:31,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-20 11:55:31,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-20 11:55:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-20 11:55:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-20 11:55:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-20 11:55:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-20 11:55:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-20 11:55:31,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-20 11:55:31,598 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021825299167504923); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036609995997793736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021825299167504923); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04833333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:31,598 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-20 11:55:31,598 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015274523076065959, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021825299167504923); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036609995997793736, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021825299167504923); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04833333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-20 11:55:31,789 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 270 ms to try 5000 different iterations.  Found a solution that moves 1015 regions; Going from a computed imbalance of 0.015274523076065959 to a new imbalance of 7.965429621116822E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006892906398847276); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01300090646930317); MoveCostFunction : (multiplier=7.0, imbalance=0.11277777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006892906398847276); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:31,793 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1284917075:82 , srv1867913518:82 , srv926028981:82 , srv1176418961:83 , srv1325133790:83 , srv1730592114:83 , srv1937719266:83 , srv1944069171:83 , srv21760227:83 , srv345508539:83 , srv46501905:83 , srv66344832:83 , srv699157541:83 , srv912173926:83 , srv958580036:83 , srv1043077925:84 , srv1165602186:84 , srv1230578951:84 , srv1261102954:84 , srv1272541005:84 , srv1296836284:84 , srv1297792186:84 , srv1504420585:84 , srv213829581:84 , srv700308128:84 , srv732357588:84 , srv810668657:84 , srv838210662:84 , srv855788454:84 , srv1082816890:85 , srv1194431322:85 , srv1255886435:85 , srv1389989401:85 , srv1430847048:85 , srv1447850356:85 , srv1485504651:85 , srv1544029943:85 , srv1621794930:85 , srv1709380924:85 , srv1803711376:85 , srv1834684709:85 , srv1877240240:85 , srv1891053887:85 , srv1892712025:85 , srv1919859518:85 , srv309652211:85 , srv433054728:85 , srv45294852:85 , srv466196357:85 , srv756486782:85 , srv756642576:85 , srv80935958:85 , srv893318005:85 , srv1105172977:86 , srv1145362209:86 , srv118117866:86 , srv1200910358:86 , srv1229054149:86 , srv1323692279:86 , srv1472669236:86 , srv1545876994:86 , srv1603599642:86 , srv1605592115:86 , srv1758382782:86 , srv2105843258:86 , srv329416308:86 , srv38500349:86 , srv483539737:86 , srv509892249:86 , srv646950163:86 , srv650044006:86 , srv934525165:86 , srv1005386:87 , srv1020746671:87 , srv1209767800:87 , srv1391203058:87 , srv1784893692:87 , srv1841535591:87 , srv1867700043:87 , srv1877586125:87 , srv1976789418:87 , srv2016134295:87 , srv2100694383:87 , srv2138666112:87 , srv385636729:87 , srv447237505:87 , srv584783502:87 , srv693859825:87 , srv838181915:87 , srv875286183:87 , srv919272965:87 , srv970149288:87 , srv1518720623:88 , srv1841827780:88 , srv2126928881:88 , srv322990566:88 , srv401837180:88 , srv640420210:88 , srv1214632405:89 , srv537945806:551 }
2023-10-20 11:55:31,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:31,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv433054728=68, srv1105172977=4, srv1194431322=9, srv1284917075=18, srv1545876994=32, srv401837180=67, srv838210662=90, srv1296836284=19, srv810668657=88, srv1472669236=27, srv38500349=65, srv1261102954=16, srv1485504651=28, srv1043077925=2, srv1297792186=20, srv926028981=96, srv1020746671=1, srv537945806=75, srv2126928881=57, srv46501905=71, srv1391203058=24, srv646950163=78, srv1877586125=47, srv509892249=74, srv329416308=63, srv385636729=66, srv1709380924=36, srv1976789418=53, srv1145362209=5, srv1255886435=15, srv1841827780=43, srv756486782=85, srv1005386=0, srv447237505=69, srv45294852=70, srv958580036=98, srv756642576=86, srv912173926=94, srv693859825=81, srv893318005=93, srv1229054149=13, srv1803711376=40, srv1784893692=39, srv1200910358=10, srv466196357=72, srv970149288=99, srv1176418961=7, srv66344832=80, srv1323692279=21, srv855788454=91, srv1082816890=3, srv1605592115=34, srv1214632405=12, srv322990566=62, srv1937719266=51, srv1230578951=14, srv650044006=79, srv1209767800=11, srv1730592114=37, srv1891053887=48, srv1165602186=6, srv1544029943=31, srv1389989401=23, srv934525165=97, srv700308128=83, srv345508539=64, srv1518720623=30, srv483539737=73, srv2016134295=54, srv2138666112=59, srv1504420585=29, srv1892712025=49, srv875286183=92, srv1603599642=33, srv309652211=61, srv838181915=89, srv1325133790=22, srv1867700043=44, srv2105843258=56, srv80935958=87, srv699157541=82, srv1834684709=41, srv640420210=77, srv1919859518=50, srv919272965=95, srv1621794930=35, srv1447850356=26, srv584783502=76, srv2100694383=55, srv1867913518=45, srv732357588=84, srv21760227=60, srv213829581=58, srv1430847048=25, srv1758382782=38, srv118117866=8, srv1877240240=46, srv1272541005=17, srv1944069171=52, srv1841535591=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:31,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:31,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:31,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:31,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:31,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:31,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:31,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:31,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-20 11:55:31,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-20 11:55:31,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-20 11:55:31,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-20 11:55:31,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-20 11:55:31,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-20 11:55:31,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-20 11:55:31,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-20 11:55:31,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-20 11:55:31,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-20 11:55:31,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-20 11:55:31,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006892906398847276); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01300090646930317); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006892906398847276); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:31,912 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-20 11:55:31,913 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.894357802068374E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006892906398847276); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01300090646930317); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006892906398847276); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-20 11:55:32,213 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 381 ms to try 5000 different iterations.  Found a solution that moves 298 regions; Going from a computed imbalance of 7.894357802068374E-4 to a new imbalance of 4.340440025724152E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.03311111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:32,214 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1214632405:83 , srv1229054149:83 , srv401837180:83 , srv584783502:83 , srv640420210:83 , srv970149288:83 , srv1005386:84 , srv1082816890:84 , srv1194431322:84 , srv1209767800:84 , srv1255886435:84 , srv1323692279:84 , srv1504420585:84 , srv1518720623:84 , srv1544029943:84 , srv1605592115:84 , srv1730592114:84 , srv1758382782:84 , srv1841827780:84 , srv1867913518:84 , srv1877586125:84 , srv1892712025:84 , srv1944069171:84 , srv2016134295:84 , srv2126928881:84 , srv322990566:84 , srv329416308:84 , srv385636729:84 , srv433054728:84 , srv447237505:84 , srv483539737:84 , srv509892249:84 , srv693859825:84 , srv756486782:84 , srv838181915:84 , srv855788454:84 , srv875286183:84 , srv893318005:84 , srv919272965:84 , srv926028981:84 , srv1020746671:85 , srv1105172977:85 , srv1145362209:85 , srv1165602186:85 , srv1176418961:85 , srv118117866:85 , srv1200910358:85 , srv1261102954:85 , srv1272541005:85 , srv1296836284:85 , srv1297792186:85 , srv1325133790:85 , srv1389989401:85 , srv1391203058:85 , srv1430847048:85 , srv1447850356:85 , srv1472669236:85 , srv1485504651:85 , srv1545876994:85 , srv1603599642:85 , srv1621794930:85 , srv1709380924:85 , srv1784893692:85 , srv1803711376:85 , srv1841535591:85 , srv1867700043:85 , srv1877240240:85 , srv1891053887:85 , srv1919859518:85 , srv1937719266:85 , srv1976789418:85 , srv2100694383:85 , srv2105843258:85 , srv213829581:85 , srv2138666112:85 , srv21760227:85 , srv309652211:85 , srv38500349:85 , srv45294852:85 , srv46501905:85 , srv466196357:85 , srv646950163:85 , srv650044006:85 , srv700308128:85 , srv756642576:85 , srv80935958:85 , srv810668657:85 , srv912173926:85 , srv934525165:85 , srv958580036:85 , srv1043077925:86 , srv1230578951:86 , srv1284917075:86 , srv1834684709:86 , srv345508539:86 , srv66344832:86 , srv699157541:86 , srv732357588:86 , srv838210662:86 , srv537945806:622 }
2023-10-20 11:55:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv433054728=68, srv1105172977=4, srv1194431322=9, srv1284917075=18, srv1545876994=32, srv401837180=67, srv838210662=90, srv1296836284=19, srv810668657=88, srv1472669236=27, srv38500349=65, srv1261102954=16, srv1485504651=28, srv1043077925=2, srv1297792186=20, srv926028981=96, srv1020746671=1, srv537945806=75, srv2126928881=57, srv46501905=71, srv1391203058=24, srv646950163=78, srv1877586125=47, srv509892249=74, srv329416308=63, srv385636729=66, srv1709380924=36, srv1976789418=53, srv1145362209=5, srv1255886435=15, srv1841827780=43, srv756486782=85, srv1005386=0, srv447237505=69, srv45294852=70, srv958580036=98, srv756642576=86, srv912173926=94, srv693859825=81, srv893318005=93, srv1229054149=13, srv1803711376=40, srv1784893692=39, srv1200910358=10, srv466196357=72, srv970149288=99, srv1176418961=7, srv66344832=80, srv1323692279=21, srv855788454=91, srv1082816890=3, srv1605592115=34, srv1214632405=12, srv322990566=62, srv1937719266=51, srv1230578951=14, srv650044006=79, srv1209767800=11, srv1730592114=37, srv1891053887=48, srv1165602186=6, srv1544029943=31, srv1389989401=23, srv934525165=97, srv700308128=83, srv345508539=64, srv1518720623=30, srv483539737=73, srv2016134295=54, srv2138666112=59, srv1504420585=29, srv1892712025=49, srv875286183=92, srv1603599642=33, srv309652211=61, srv838181915=89, srv1325133790=22, srv1867700043=44, srv2105843258=56, srv80935958=87, srv699157541=82, srv1834684709=41, srv640420210=77, srv1919859518=50, srv919272965=95, srv1621794930=35, srv1447850356=26, srv584783502=76, srv2100694383=55, srv1867913518=45, srv732357588=84, srv21760227=60, srv213829581=58, srv1430847048=25, srv1758382782=38, srv118117866=8, srv1877240240=46, srv1272541005=17, srv1944069171=52, srv1841535591=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:32,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:32,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:32,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-20 11:55:32,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-20 11:55:32,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-20 11:55:32,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-20 11:55:32,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-20 11:55:32,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-20 11:55:32,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-20 11:55:32,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-20 11:55:32,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-20 11:55:32,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-20 11:55:32,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-20 11:55:32,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-20 11:55:32,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-20 11:55:32,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:32,350 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-20 11:55:32,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.131775965857773E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-20 11:55:32,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 283 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 4.131775965857773E-5 to a new imbalance of 7.906488439809095E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:32,538 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1261102954:83 , srv1297792186:83 , srv1709380924:83 , srv1834684709:83 , srv1841535591:83 , srv466196357:83 , srv875286183:83 , srv1005386:84 , srv1020746671:84 , srv1043077925:84 , srv1105172977:84 , srv1145362209:84 , srv1165602186:84 , srv1176418961:84 , srv118117866:84 , srv1194431322:84 , srv1200910358:84 , srv1209767800:84 , srv1214632405:84 , srv1229054149:84 , srv1230578951:84 , srv1272541005:84 , srv1284917075:84 , srv1296836284:84 , srv1323692279:84 , srv1325133790:84 , srv1389989401:84 , srv1391203058:84 , srv1430847048:84 , srv1447850356:84 , srv1472669236:84 , srv1485504651:84 , srv1504420585:84 , srv1518720623:84 , srv1545876994:84 , srv1603599642:84 , srv1605592115:84 , srv1621794930:84 , srv1730592114:84 , srv1758382782:84 , srv1784893692:84 , srv1803711376:84 , srv1841827780:84 , srv1867700043:84 , srv1867913518:84 , srv1877240240:84 , srv1877586125:84 , srv1891053887:84 , srv1892712025:84 , srv1919859518:84 , srv1937719266:84 , srv1976789418:84 , srv2016134295:84 , srv2100694383:84 , srv2105843258:84 , srv2126928881:84 , srv213829581:84 , srv2138666112:84 , srv21760227:84 , srv309652211:84 , srv322990566:84 , srv329416308:84 , srv345508539:84 , srv38500349:84 , srv385636729:84 , srv401837180:84 , srv433054728:84 , srv447237505:84 , srv45294852:84 , srv46501905:84 , srv483539737:84 , srv509892249:84 , srv584783502:84 , srv640420210:84 , srv646950163:84 , srv650044006:84 , srv66344832:84 , srv693859825:84 , srv699157541:84 , srv700308128:84 , srv732357588:84 , srv756642576:84 , srv80935958:84 , srv810668657:84 , srv838181915:84 , srv838210662:84 , srv855788454:84 , srv893318005:84 , srv912173926:84 , srv919272965:84 , srv926028981:84 , srv934525165:84 , srv958580036:84 , srv1082816890:85 , srv1255886435:85 , srv1544029943:85 , srv1944069171:85 , srv756486782:85 , srv970149288:85 , srv537945806:685 }
2023-10-20 11:55:32,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:32,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv433054728=68, srv1105172977=4, srv1194431322=9, srv1284917075=18, srv1545876994=32, srv401837180=67, srv838210662=90, srv1296836284=19, srv810668657=88, srv1472669236=27, srv38500349=65, srv1261102954=16, srv1485504651=28, srv1043077925=2, srv1297792186=20, srv926028981=96, srv1020746671=1, srv537945806=75, srv2126928881=57, srv46501905=71, srv1391203058=24, srv646950163=78, srv1877586125=47, srv509892249=74, srv329416308=63, srv385636729=66, srv1709380924=36, srv1976789418=53, srv1145362209=5, srv1255886435=15, srv1841827780=43, srv756486782=85, srv1005386=0, srv447237505=69, srv45294852=70, srv958580036=98, srv756642576=86, srv912173926=94, srv693859825=81, srv893318005=93, srv1229054149=13, srv1803711376=40, srv1784893692=39, srv1200910358=10, srv466196357=72, srv970149288=99, srv1176418961=7, srv66344832=80, srv1323692279=21, srv855788454=91, srv1082816890=3, srv1605592115=34, srv1214632405=12, srv322990566=62, srv1937719266=51, srv1230578951=14, srv650044006=79, srv1209767800=11, srv1730592114=37, srv1891053887=48, srv1165602186=6, srv1544029943=31, srv1389989401=23, srv934525165=97, srv700308128=83, srv345508539=64, srv1518720623=30, srv483539737=73, srv2016134295=54, srv2138666112=59, srv1504420585=29, srv1892712025=49, srv875286183=92, srv1603599642=33, srv309652211=61, srv838181915=89, srv1325133790=22, srv1867700043=44, srv2105843258=56, srv80935958=87, srv699157541=82, srv1834684709=41, srv640420210=77, srv1919859518=50, srv919272965=95, srv1621794930=35, srv1447850356=26, srv584783502=76, srv2100694383=55, srv1867913518=45, srv732357588=84, srv21760227=60, srv213829581=58, srv1430847048=25, srv1758382782=38, srv118117866=8, srv1877240240=46, srv1272541005=17, srv1944069171=52, srv1841535591=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:32,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:32,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:32,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:32,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:32,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:32,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-20 11:55:32,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-20 11:55:32,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-20 11:55:32,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-20 11:55:32,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-20 11:55:32,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-20 11:55:32,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-20 11:55:32,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:32,672 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1261102954:83 , srv1297792186:83 , srv1709380924:83 , srv1834684709:83 , srv1841535591:83 , srv466196357:83 , srv875286183:83 , srv1005386:84 , srv1020746671:84 , srv1043077925:84 , srv1105172977:84 , srv1145362209:84 , srv1165602186:84 , srv1176418961:84 , srv118117866:84 , srv1194431322:84 , srv1200910358:84 , srv1209767800:84 , srv1214632405:84 , srv1229054149:84 , srv1230578951:84 , srv1272541005:84 , srv1284917075:84 , srv1296836284:84 , srv1323692279:84 , srv1325133790:84 , srv1389989401:84 , srv1391203058:84 , srv1430847048:84 , srv1447850356:84 , srv1472669236:84 , srv1485504651:84 , srv1504420585:84 , srv1518720623:84 , srv1545876994:84 , srv1603599642:84 , srv1605592115:84 , srv1621794930:84 , srv1730592114:84 , srv1758382782:84 , srv1784893692:84 , srv1803711376:84 , srv1841827780:84 , srv1867700043:84 , srv1867913518:84 , srv1877240240:84 , srv1877586125:84 , srv1891053887:84 , srv1892712025:84 , srv1919859518:84 , srv1937719266:84 , srv1976789418:84 , srv2016134295:84 , srv2100694383:84 , srv2105843258:84 , srv2126928881:84 , srv213829581:84 , srv2138666112:84 , srv21760227:84 , srv309652211:84 , srv322990566:84 , srv329416308:84 , srv345508539:84 , srv38500349:84 , srv385636729:84 , srv401837180:84 , srv433054728:84 , srv447237505:84 , srv45294852:84 , srv46501905:84 , srv483539737:84 , srv509892249:84 , srv584783502:84 , srv640420210:84 , srv646950163:84 , srv650044006:84 , srv66344832:84 , srv693859825:84 , srv699157541:84 , srv700308128:84 , srv732357588:84 , srv756642576:84 , srv80935958:84 , srv810668657:84 , srv838181915:84 , srv838210662:84 , srv855788454:84 , srv893318005:84 , srv912173926:84 , srv919272965:84 , srv926028981:84 , srv934525165:84 , srv958580036:84 , srv1082816890:85 , srv1255886435:85 , srv1544029943:85 , srv1944069171:85 , srv756486782:85 , srv970149288:85 , srv537945806:685 }
2023-10-20 11:55:32,710 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=486 (was 486), ProcessCount=179 (was 180), AvailableMemoryMB=1259 (was 1898)
2023-10-20 11:55:32,720 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=486, ProcessCount=179, AvailableMemoryMB=1259
2023-10-20 11:55:32,721 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-20 11:55:32,721 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-20 11:55:32,733 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003495127:84 , srv1015562179:84 , srv1027707287:84 , srv1032048075:84 , srv1123382694:84 , srv1128103794:84 , srv1253735256:84 , srv1326580765:84 , srv1346345678:84 , srv1454394056:84 , srv1466775878:84 , srv1760910168:84 , srv1794756253:84 , srv1797614489:84 , srv1889172513:84 , srv1925489152:84 , srv1926679130:84 , srv2032173148:84 , srv2068920858:84 , srv209982847:84 , srv2107565600:84 , srv248900825:84 , srv325933984:84 , srv378642680:84 , srv380056073:84 , srv403152394:84 , srv622649345:84 , srv773022029:84 , srv812900688:84 , srv528810068:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-20 11:55:32,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:55:32,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1128103794=5, srv1454394056=9, srv1027707287=2, srv2032173148=17, srv1889172513=14, srv209982847=19, srv528810068=26, srv622649345=27, srv1123382694=4, srv378642680=23, srv380056073=24, srv812900688=29, srv1797614489=13, srv1794756253=12, srv1253735256=6, srv1466775878=10, srv1346345678=8, srv1925489152=15, srv1926679130=16, srv325933984=22, srv1003495127=0, srv1760910168=11, srv773022029=28, srv1015562179=1, srv1032048075=3, srv248900825=21, srv2107565600=20, srv403152394=25, srv1326580765=7, srv2068920858=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:55:32,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:55:32,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:55:32,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:55:32,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:55:32,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:55:32,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:55:32,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-20 11:55:32,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.137962144331143, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:55:32,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912627757476188, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.137962144331143, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-20 11:57:32,754 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 8470890 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912627757476188 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:57:32,759 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1003495127:90 , srv1015562179:90 , srv1027707287:90 , srv1032048075:90 , srv1123382694:90 , srv1128103794:90 , srv1253735256:90 , srv1326580765:90 , srv1346345678:90 , srv1454394056:90 , srv1466775878:90 , srv1760910168:90 , srv1794756253:90 , srv1797614489:90 , srv1889172513:90 , srv1925489152:90 , srv1926679130:90 , srv2032173148:90 , srv2068920858:90 , srv209982847:90 , srv2107565600:90 , srv248900825:90 , srv325933984:90 , srv378642680:90 , srv380056073:90 , srv403152394:90 , srv528810068:90 , srv622649345:90 , srv773022029:90 , srv812900688:90 }
2023-10-20 11:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-20 11:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1128103794=5, srv1454394056=9, srv1027707287=2, srv2032173148=17, srv1889172513=14, srv209982847=19, srv528810068=26, srv622649345=27, srv1123382694=4, srv378642680=23, srv380056073=24, srv812900688=29, srv1797614489=13, srv1794756253=12, srv1253735256=6, srv1466775878=10, srv1346345678=8, srv1925489152=15, srv1926679130=16, srv325933984=22, srv1003495127=0, srv1760910168=11, srv773022029=28, srv1015562179=1, srv1032048075=3, srv248900825=21, srv2107565600=20, srv403152394=25, srv1326580765=7, srv2068920858=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-20 11:57:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-20 11:57:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-20 11:57:32,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-20 11:57:32,777 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1003495127:90 , srv1015562179:90 , srv1027707287:90 , srv1032048075:90 , srv1123382694:90 , srv1128103794:90 , srv1253735256:90 , srv1326580765:90 , srv1346345678:90 , srv1454394056:90 , srv1466775878:90 , srv1760910168:90 , srv1794756253:90 , srv1797614489:90 , srv1889172513:90 , srv1925489152:90 , srv1926679130:90 , srv2032173148:90 , srv2068920858:90 , srv209982847:90 , srv2107565600:90 , srv248900825:90 , srv325933984:90 , srv378642680:90 , srv380056073:90 , srv403152394:90 , srv528810068:90 , srv622649345:90 , srv773022029:90 , srv812900688:90 }
2023-10-20 11:57:32,792 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 486), ProcessCount=176 (was 179), AvailableMemoryMB=860 (was 1259)