2023-08-09 00:53:12,027 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-09 00:53:12,364 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-09 00:53:12,483 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-09 00:53:12,552 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-09 00:53:12,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-09 00:53:12,577 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=175, AvailableMemoryMB=2826
2023-08-09 00:53:12,579 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-09 00:53:12,579 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-09 00:53:12,735 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022393368:84 , srv1031719882:84 , srv1050913649:84 , srv1083459488:84 , srv1124789706:84 , srv1135664793:84 , srv1141071374:84 , srv1152231099:84 , srv1210106798:84 , srv1231127044:84 , srv1252782987:84 , srv1280916884:84 , srv1313072064:84 , srv1316129808:84 , srv1322813062:84 , srv1328731101:84 , srv1393862036:84 , srv1428993676:84 , srv143908624:84 , srv1447304932:84 , srv1454234853:84 , srv1468451196:84 , srv1468531769:84 , srv1489887147:84 , srv1501852826:84 , srv1503140746:84 , srv1514885872:84 , srv1541531481:84 , srv154168072:84 , srv1543640337:84 , srv1549371792:84 , srv1571536985:84 , srv1574113102:84 , srv1579517503:84 , srv1592369351:84 , srv1596955912:84 , srv1597465970:84 , srv1667504371:84 , srv1670945384:84 , srv1714878740:84 , srv177627471:84 , srv1794117411:84 , srv1797277476:84 , srv1814349637:84 , srv1833924693:84 , srv1844477163:84 , srv1886842611:84 , srv1898921449:84 , srv1921776691:84 , srv1946569602:84 , srv1960398764:84 , srv1962063867:84 , srv1973786003:84 , srv2001292332:84 , srv2015420695:84 , srv208323664:84 , srv2088023219:84 , srv2109243443:84 , srv2217111:84 , srv228556098:84 , srv268627423:84 , srv276180841:84 , srv294507443:84 , srv298043808:84 , srv303022009:84 , srv327173940:84 , srv384317384:84 , srv38667560:84 , srv397812252:84 , srv415532552:84 , srv427700371:84 , srv44840630:84 , srv457891423:84 , srv547950704:84 , srv556745253:84 , srv559073907:84 , srv580759313:84 , srv583916721:84 , srv591019957:84 , srv633066906:84 , srv655068756:84 , srv670799746:84 , srv678769356:84 , srv680911364:84 , srv68612194:84 , srv696514445:84 , srv720501363:84 , srv7435876:84 , srv757417818:84 , srv761239963:84 , srv765735096:84 , srv796699518:84 , srv827048686:84 , srv828079333:84 , srv910054734:84 , srv912083771:84 , srv927041179:84 , srv958385793:84 , srv958530646:84 , srv977168668:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-09 00:53:12,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:12,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv397812252=68, srv1797277476=42, srv1596955912=35, srv298043808=63, srv1667504371=37, srv1210106798=8, srv38667560=67, srv1962063867=51, srv1592369351=34, srv1946569602=49, srv457891423=72, srv1152231099=7, srv1814349637=43, srv958530646=98, srv1468531769=22, srv1468451196=21, srv912083771=95, srv1973786003=52, srv633066906=79, srv208323664=55, srv2109243443=57, srv1571536985=31, srv1328731101=15, srv1844477163=45, srv678769356=82, srv177627471=40, srv1141071374=6, srv910054734=94, srv580759313=76, srv796699518=91, srv958385793=97, srv1083459488=3, srv1833924693=44, srv2217111=58, srv1124789706=4, srv268627423=60, srv1574113102=32, srv303022009=64, srv1447304932=19, srv1501852826=24, srv154168072=28, srv2015420695=54, srv1794117411=41, srv1960398764=50, srv1022393368=0, srv327173940=65, srv583916721=77, srv765735096=90, srv1454234853=20, srv276180841=61, srv228556098=59, srv427700371=70, srv1252782987=10, srv415532552=69, srv1549371792=30, srv1886842611=46, srv143908624=18, srv1670945384=38, srv1135664793=5, srv655068756=80, srv1393862036=16, srv1921776691=48, srv927041179=96, srv977168668=99, srv559073907=75, srv670799746=81, srv44840630=71, srv1543640337=29, srv828079333=93, srv384317384=66, srv1322813062=14, srv2001292332=53, srv1898921449=47, srv1031719882=1, srv7435876=87, srv1231127044=9, srv696514445=85, srv1579517503=33, srv761239963=89, srv1503140746=25, srv1714878740=39, srv68612194=84, srv1514885872=26, srv2088023219=56, srv1541531481=27, srv757417818=88, srv720501363=86, srv294507443=62, srv1489887147=23, srv680911364=83, srv547950704=73, srv1050913649=2, srv1428993676=17, srv1280916884=11, srv591019957=78, srv827048686=92, srv1313072064=12, srv1316129808=13, srv1597465970=36, srv556745253=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:12,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:12,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:12,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:12,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:12,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:12,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-09 00:53:12,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-09 00:53:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-09 00:53:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-09 00:53:12,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-09 00:53:12,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-09 00:53:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-09 00:53:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-09 00:53:13,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:13,011 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-09 00:53:13,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-09 00:53:13,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 561 ms to try 5000 different iterations.  Found a solution that moves 4705 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1782015664398461. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042504226882812475, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05872571255741374, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5227777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042504226882812475, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17333333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2405, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:13,450 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1022393368:83 , srv1124789706:83 , srv1141071374:83 , srv1503140746:83 , srv1574113102:83 , srv1579517503:83 , srv1592369351:83 , srv2001292332:83 , srv208323664:83 , srv268627423:83 , srv384317384:83 , srv761239963:83 , srv1031719882:84 , srv1050913649:84 , srv1231127044:84 , srv1322813062:84 , srv1393862036:84 , srv1468451196:84 , srv154168072:84 , srv1833924693:84 , srv1886842611:84 , srv2088023219:84 , srv44840630:84 , srv457891423:84 , srv591019957:84 , srv958530646:84 , srv1083459488:85 , srv1210106798:85 , srv1313072064:85 , srv1468531769:85 , srv1670945384:85 , srv1714878740:85 , srv1921776691:85 , srv1946569602:85 , srv276180841:85 , srv294507443:85 , srv327173940:85 , srv415532552:85 , srv427700371:85 , srv547950704:85 , srv670799746:85 , srv68612194:85 , srv7435876:85 , srv910054734:85 , srv1152231099:86 , srv1252782987:86 , srv1280916884:86 , srv1428993676:86 , srv143908624:86 , srv1541531481:86 , srv1597465970:86 , srv1667504371:86 , srv177627471:86 , srv1898921449:86 , srv2109243443:86 , srv580759313:86 , srv633066906:86 , srv720501363:86 , srv757417818:86 , srv1135664793:87 , srv1328731101:87 , srv1489887147:87 , srv1514885872:87 , srv1549371792:87 , srv1794117411:87 , srv228556098:87 , srv298043808:87 , srv303022009:87 , srv556745253:87 , srv655068756:87 , srv678769356:87 , srv680911364:87 , srv696514445:87 , srv827048686:87 , srv828079333:87 , srv1316129808:88 , srv1454234853:88 , srv1596955912:88 , srv1797277476:88 , srv1962063867:88 , srv1973786003:88 , srv2015420695:88 , srv2217111:88 , srv38667560:88 , srv1447304932:89 , srv1501852826:89 , srv1543640337:89 , srv1571536985:89 , srv927041179:89 , srv559073907:90 , srv796699518:90 , srv958385793:90 , srv1844477163:91 , srv1960398764:91 , srv397812252:91 , srv912083771:91 , srv1814349637:92 , srv765735096:92 , srv583916721:93 , srv977168668:468 }
2023-08-09 00:53:13,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:13,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv397812252=68, srv1797277476=42, srv1596955912=35, srv298043808=63, srv1667504371=37, srv1210106798=8, srv38667560=67, srv1962063867=51, srv1592369351=34, srv1946569602=49, srv457891423=72, srv1152231099=7, srv1814349637=43, srv958530646=98, srv1468531769=22, srv1468451196=21, srv912083771=95, srv1973786003=52, srv633066906=79, srv208323664=55, srv2109243443=57, srv1571536985=31, srv1328731101=15, srv1844477163=45, srv678769356=82, srv177627471=40, srv1141071374=6, srv910054734=94, srv580759313=76, srv796699518=91, srv958385793=97, srv1083459488=3, srv1833924693=44, srv2217111=58, srv1124789706=4, srv268627423=60, srv1574113102=32, srv303022009=64, srv1447304932=19, srv1501852826=24, srv154168072=28, srv2015420695=54, srv1794117411=41, srv1960398764=50, srv1022393368=0, srv327173940=65, srv583916721=77, srv765735096=90, srv1454234853=20, srv276180841=61, srv228556098=59, srv427700371=70, srv1252782987=10, srv415532552=69, srv1549371792=30, srv1886842611=46, srv143908624=18, srv1670945384=38, srv1135664793=5, srv655068756=80, srv1393862036=16, srv1921776691=48, srv927041179=96, srv977168668=99, srv559073907=75, srv670799746=81, srv44840630=71, srv1543640337=29, srv828079333=93, srv384317384=66, srv1322813062=14, srv2001292332=53, srv1898921449=47, srv1031719882=1, srv7435876=87, srv1231127044=9, srv696514445=85, srv1579517503=33, srv761239963=89, srv1503140746=25, srv1714878740=39, srv68612194=84, srv1514885872=26, srv2088023219=56, srv1541531481=27, srv757417818=88, srv720501363=86, srv294507443=62, srv1489887147=23, srv680911364=83, srv547950704=73, srv1050913649=2, srv1428993676=17, srv1280916884=11, srv591019957=78, srv827048686=92, srv1313072064=12, srv1316129808=13, srv1597465970=36, srv556745253=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:13,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:13,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:13,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:13,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:13,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:13,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:13,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-09 00:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-09 00:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-09 00:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-09 00:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-09 00:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-09 00:53:13,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-09 00:53:13,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-09 00:53:13,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-09 00:53:13,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-09 00:53:13,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-09 00:53:13,665 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042504226882812475, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05872571255741374, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042504226882812475, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17333333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2405, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:13,665 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-09 00:53:13,665 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17816862132569608, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042504226882812475, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05872571255741374, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042504226882812475, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17333333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2405, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-09 00:53:14,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 537 ms to try 5000 different iterations.  Found a solution that moves 2611 regions; Going from a computed imbalance of 0.17816862132569608 to a new imbalance of 0.015866982052368583. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025072534754235945, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0356910297859692, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2901111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025072534754235945, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:14,076 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv583916721:77 , srv397812252:79 , srv765735096:79 , srv1814349637:80 , srv1844477163:80 , srv912083771:80 , srv1571536985:81 , srv796699518:81 , srv1447304932:82 , srv1501852826:82 , srv559073907:82 , srv1252782987:83 , srv1280916884:83 , srv1596955912:83 , srv1797277476:83 , srv1960398764:83 , srv1973786003:83 , srv2217111:83 , srv927041179:83 , srv958385793:83 , srv1135664793:84 , srv1313072064:84 , srv1328731101:84 , srv1543640337:84 , srv1667504371:84 , srv1794117411:84 , srv1962063867:84 , srv228556098:84 , srv38667560:84 , srv415532552:84 , srv427700371:84 , srv655068756:84 , srv696514445:84 , srv1316129808:85 , srv1454234853:85 , srv1489887147:85 , srv2015420695:85 , srv276180841:85 , srv298043808:85 , srv547950704:85 , srv68612194:85 , srv720501363:85 , srv7435876:85 , srv828079333:85 , srv1141071374:86 , srv1428993676:86 , srv143908624:86 , srv1514885872:86 , srv1541531481:86 , srv1549371792:86 , srv177627471:86 , srv1898921449:86 , srv2109243443:86 , srv303022009:86 , srv44840630:86 , srv556745253:86 , srv580759313:86 , srv633066906:86 , srv678769356:86 , srv680911364:86 , srv827048686:86 , srv958530646:86 , srv1050913649:87 , srv1083459488:87 , srv1152231099:87 , srv1393862036:87 , srv1579517503:87 , srv1592369351:87 , srv1597465970:87 , srv1714878740:87 , srv1833924693:87 , srv1921776691:87 , srv1946569602:87 , srv2088023219:87 , srv327173940:87 , srv591019957:87 , srv757417818:87 , srv1031719882:88 , srv1124789706:88 , srv1210106798:88 , srv1468531769:88 , srv1503140746:88 , srv294507443:88 , srv670799746:88 , srv1022393368:89 , srv1322813062:89 , srv154168072:89 , srv1670945384:89 , srv1886842611:89 , srv268627423:89 , srv910054734:89 , srv1231127044:90 , srv1574113102:90 , srv2001292332:90 , srv384317384:90 , srv457891423:90 , srv761239963:90 , srv1468451196:91 , srv208323664:91 , srv977168668:529 }
2023-08-09 00:53:14,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:14,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv397812252=68, srv1797277476=42, srv1596955912=35, srv298043808=63, srv1667504371=37, srv1210106798=8, srv38667560=67, srv1962063867=51, srv1592369351=34, srv1946569602=49, srv457891423=72, srv1152231099=7, srv1814349637=43, srv958530646=98, srv1468531769=22, srv1468451196=21, srv912083771=95, srv1973786003=52, srv633066906=79, srv208323664=55, srv2109243443=57, srv1571536985=31, srv1328731101=15, srv1844477163=45, srv678769356=82, srv177627471=40, srv1141071374=6, srv910054734=94, srv580759313=76, srv796699518=91, srv958385793=97, srv1083459488=3, srv1833924693=44, srv2217111=58, srv1124789706=4, srv268627423=60, srv1574113102=32, srv303022009=64, srv1447304932=19, srv1501852826=24, srv154168072=28, srv2015420695=54, srv1794117411=41, srv1960398764=50, srv1022393368=0, srv327173940=65, srv583916721=77, srv765735096=90, srv1454234853=20, srv276180841=61, srv228556098=59, srv427700371=70, srv1252782987=10, srv415532552=69, srv1549371792=30, srv1886842611=46, srv143908624=18, srv1670945384=38, srv1135664793=5, srv655068756=80, srv1393862036=16, srv1921776691=48, srv927041179=96, srv977168668=99, srv559073907=75, srv670799746=81, srv44840630=71, srv1543640337=29, srv828079333=93, srv384317384=66, srv1322813062=14, srv2001292332=53, srv1898921449=47, srv1031719882=1, srv7435876=87, srv1231127044=9, srv696514445=85, srv1579517503=33, srv761239963=89, srv1503140746=25, srv1714878740=39, srv68612194=84, srv1514885872=26, srv2088023219=56, srv1541531481=27, srv757417818=88, srv720501363=86, srv294507443=62, srv1489887147=23, srv680911364=83, srv547950704=73, srv1050913649=2, srv1428993676=17, srv1280916884=11, srv591019957=78, srv827048686=92, srv1313072064=12, srv1316129808=13, srv1597465970=36, srv556745253=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-09 00:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-09 00:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-09 00:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-09 00:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-09 00:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-09 00:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-09 00:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-09 00:53:14,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025072534754235945, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0356910297859692, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025072534754235945, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:14,236 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-09 00:53:14,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015848699439606467, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025072534754235945, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0356910297859692, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025072534754235945, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-09 00:53:14,595 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 463 ms to try 5000 different iterations.  Found a solution that moves 957 regions; Going from a computed imbalance of 0.015848699439606467 to a new imbalance of 7.181505117112007E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008244003061747671); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010896925502620088); MoveCostFunction : (multiplier=7.0, imbalance=0.10633333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008244003061747671); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:14,597 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1468451196:83 , srv1514885872:83 , srv1549371792:83 , srv1574113102:83 , srv208323664:83 , srv268627423:83 , srv457891423:83 , srv678769356:83 , srv910054734:83 , srv1210106798:84 , srv1231127044:84 , srv1322813062:84 , srv1468531769:84 , srv1541531481:84 , srv154168072:84 , srv1670945384:84 , srv1886842611:84 , srv1960398764:84 , srv1962063867:84 , srv2001292332:84 , srv2015420695:84 , srv294507443:84 , srv384317384:84 , srv761239963:84 , srv1022393368:85 , srv1083459488:85 , srv1135664793:85 , srv1152231099:85 , srv1316129808:85 , srv1428993676:85 , srv143908624:85 , srv1454234853:85 , srv1597465970:85 , srv1714878740:85 , srv177627471:85 , srv1921776691:85 , srv1946569602:85 , srv2109243443:85 , srv2217111:85 , srv228556098:85 , srv298043808:85 , srv303022009:85 , srv327173940:85 , srv38667560:85 , srv556745253:85 , srv559073907:85 , srv591019957:85 , srv633066906:85 , srv655068756:85 , srv670799746:85 , srv680911364:85 , srv757417818:85 , srv827048686:85 , srv958385793:85 , srv1050913649:86 , srv1124789706:86 , srv1393862036:86 , srv1489887147:86 , srv1501852826:86 , srv1543640337:86 , srv1596955912:86 , srv1794117411:86 , srv1814349637:86 , srv1898921449:86 , srv1973786003:86 , srv580759313:86 , srv68612194:86 , srv765735096:86 , srv796699518:86 , srv828079333:86 , srv912083771:86 , srv958530646:86 , srv1031719882:87 , srv1280916884:87 , srv1328731101:87 , srv1447304932:87 , srv1503140746:87 , srv1571536985:87 , srv1579517503:87 , srv1592369351:87 , srv1797277476:87 , srv1833924693:87 , srv1844477163:87 , srv427700371:87 , srv44840630:87 , srv547950704:87 , srv696514445:87 , srv720501363:87 , srv927041179:87 , srv1141071374:88 , srv1252782987:88 , srv1313072064:88 , srv2088023219:88 , srv276180841:88 , srv397812252:88 , srv415532552:88 , srv7435876:88 , srv1667504371:89 , srv583916721:89 , srv977168668:534 }
2023-08-09 00:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv397812252=68, srv1797277476=42, srv1596955912=35, srv298043808=63, srv1667504371=37, srv1210106798=8, srv38667560=67, srv1962063867=51, srv1592369351=34, srv1946569602=49, srv457891423=72, srv1152231099=7, srv1814349637=43, srv958530646=98, srv1468531769=22, srv1468451196=21, srv912083771=95, srv1973786003=52, srv633066906=79, srv208323664=55, srv2109243443=57, srv1571536985=31, srv1328731101=15, srv1844477163=45, srv678769356=82, srv177627471=40, srv1141071374=6, srv910054734=94, srv580759313=76, srv796699518=91, srv958385793=97, srv1083459488=3, srv1833924693=44, srv2217111=58, srv1124789706=4, srv268627423=60, srv1574113102=32, srv303022009=64, srv1447304932=19, srv1501852826=24, srv154168072=28, srv2015420695=54, srv1794117411=41, srv1960398764=50, srv1022393368=0, srv327173940=65, srv583916721=77, srv765735096=90, srv1454234853=20, srv276180841=61, srv228556098=59, srv427700371=70, srv1252782987=10, srv415532552=69, srv1549371792=30, srv1886842611=46, srv143908624=18, srv1670945384=38, srv1135664793=5, srv655068756=80, srv1393862036=16, srv1921776691=48, srv927041179=96, srv977168668=99, srv559073907=75, srv670799746=81, srv44840630=71, srv1543640337=29, srv828079333=93, srv384317384=66, srv1322813062=14, srv2001292332=53, srv1898921449=47, srv1031719882=1, srv7435876=87, srv1231127044=9, srv696514445=85, srv1579517503=33, srv761239963=89, srv1503140746=25, srv1714878740=39, srv68612194=84, srv1514885872=26, srv2088023219=56, srv1541531481=27, srv757417818=88, srv720501363=86, srv294507443=62, srv1489887147=23, srv680911364=83, srv547950704=73, srv1050913649=2, srv1428993676=17, srv1280916884=11, srv591019957=78, srv827048686=92, srv1313072064=12, srv1316129808=13, srv1597465970=36, srv556745253=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-09 00:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-09 00:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-09 00:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-09 00:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-09 00:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-09 00:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-09 00:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-09 00:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-09 00:53:14,799 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008244003061747671); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010896925502620088); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008244003061747671); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:14,799 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-09 00:53:14,800 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.114494544866329E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008244003061747671); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010896925502620088); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008244003061747671); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-09 00:53:15,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 474 ms to try 5000 different iterations.  Found a solution that moves 281 regions; Going from a computed imbalance of 7.114494544866329E-4 to a new imbalance of 2.6674121436655825E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.03122222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:15,132 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1031719882:83 , srv1152231099:83 , srv1468451196:83 , srv1543640337:83 , srv1667504371:83 , srv2088023219:83 , srv583916721:83 , srv927041179:83 , srv1210106798:84 , srv1231127044:84 , srv1316129808:84 , srv1328731101:84 , srv1447304932:84 , srv1489887147:84 , srv1503140746:84 , srv1596955912:84 , srv1597465970:84 , srv1670945384:84 , srv1714878740:84 , srv1797277476:84 , srv1814349637:84 , srv1833924693:84 , srv1844477163:84 , srv1960398764:84 , srv276180841:84 , srv303022009:84 , srv397812252:84 , srv556745253:84 , srv580759313:84 , srv670799746:84 , srv680911364:84 , srv720501363:84 , srv7435876:84 , srv757417818:84 , srv827048686:84 , srv828079333:84 , srv958385793:84 , srv1022393368:85 , srv1050913649:85 , srv1083459488:85 , srv1124789706:85 , srv1141071374:85 , srv1252782987:85 , srv1313072064:85 , srv1322813062:85 , srv1428993676:85 , srv143908624:85 , srv1454234853:85 , srv1468531769:85 , srv1501852826:85 , srv1541531481:85 , srv154168072:85 , srv1571536985:85 , srv1579517503:85 , srv1592369351:85 , srv177627471:85 , srv1794117411:85 , srv1886842611:85 , srv1898921449:85 , srv1921776691:85 , srv1946569602:85 , srv1973786003:85 , srv2001292332:85 , srv2015420695:85 , srv208323664:85 , srv2109243443:85 , srv228556098:85 , srv294507443:85 , srv298043808:85 , srv327173940:85 , srv384317384:85 , srv38667560:85 , srv415532552:85 , srv44840630:85 , srv457891423:85 , srv547950704:85 , srv559073907:85 , srv633066906:85 , srv696514445:85 , srv761239963:85 , srv796699518:85 , srv910054734:85 , srv912083771:85 , srv1280916884:86 , srv1393862036:86 , srv1514885872:86 , srv1574113102:86 , srv1962063867:86 , srv2217111:86 , srv427700371:86 , srv591019957:86 , srv655068756:86 , srv678769356:86 , srv68612194:86 , srv765735096:86 , srv958530646:86 , srv1135664793:87 , srv1549371792:87 , srv268627423:87 , srv977168668:611 }
2023-08-09 00:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv397812252=68, srv1797277476=42, srv1596955912=35, srv298043808=63, srv1667504371=37, srv1210106798=8, srv38667560=67, srv1962063867=51, srv1592369351=34, srv1946569602=49, srv457891423=72, srv1152231099=7, srv1814349637=43, srv958530646=98, srv1468531769=22, srv1468451196=21, srv912083771=95, srv1973786003=52, srv633066906=79, srv208323664=55, srv2109243443=57, srv1571536985=31, srv1328731101=15, srv1844477163=45, srv678769356=82, srv177627471=40, srv1141071374=6, srv910054734=94, srv580759313=76, srv796699518=91, srv958385793=97, srv1083459488=3, srv1833924693=44, srv2217111=58, srv1124789706=4, srv268627423=60, srv1574113102=32, srv303022009=64, srv1447304932=19, srv1501852826=24, srv154168072=28, srv2015420695=54, srv1794117411=41, srv1960398764=50, srv1022393368=0, srv327173940=65, srv583916721=77, srv765735096=90, srv1454234853=20, srv276180841=61, srv228556098=59, srv427700371=70, srv1252782987=10, srv415532552=69, srv1549371792=30, srv1886842611=46, srv143908624=18, srv1670945384=38, srv1135664793=5, srv655068756=80, srv1393862036=16, srv1921776691=48, srv927041179=96, srv977168668=99, srv559073907=75, srv670799746=81, srv44840630=71, srv1543640337=29, srv828079333=93, srv384317384=66, srv1322813062=14, srv2001292332=53, srv1898921449=47, srv1031719882=1, srv7435876=87, srv1231127044=9, srv696514445=85, srv1579517503=33, srv761239963=89, srv1503140746=25, srv1714878740=39, srv68612194=84, srv1514885872=26, srv2088023219=56, srv1541531481=27, srv757417818=88, srv720501363=86, srv294507443=62, srv1489887147=23, srv680911364=83, srv547950704=73, srv1050913649=2, srv1428993676=17, srv1280916884=11, srv591019957=78, srv827048686=92, srv1313072064=12, srv1316129808=13, srv1597465970=36, srv556745253=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-09 00:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-09 00:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-09 00:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-09 00:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-09 00:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-09 00:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-09 00:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-09 00:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-09 00:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-09 00:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-09 00:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-09 00:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-09 00:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-09 00:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-09 00:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-09 00:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-09 00:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-09 00:53:15,272 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:15,272 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-09 00:53:15,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.470651738221111E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-09 00:53:15,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 408 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 2.470651738221111E-5 to a new imbalance of 7.199277990208469E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:15,575 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1135664793:83 , srv1393862036:83 , srv1454234853:83 , srv1549371792:83 , srv1898921449:83 , srv696514445:83 , srv765735096:83 , srv1022393368:84 , srv1031719882:84 , srv1050913649:84 , srv1083459488:84 , srv1124789706:84 , srv1141071374:84 , srv1231127044:84 , srv1252782987:84 , srv1280916884:84 , srv1313072064:84 , srv1316129808:84 , srv1322813062:84 , srv1328731101:84 , srv1428993676:84 , srv143908624:84 , srv1447304932:84 , srv1468531769:84 , srv1489887147:84 , srv1501852826:84 , srv1503140746:84 , srv1514885872:84 , srv154168072:84 , srv1543640337:84 , srv1571536985:84 , srv1574113102:84 , srv1579517503:84 , srv1592369351:84 , srv1597465970:84 , srv1667504371:84 , srv1670945384:84 , srv177627471:84 , srv1794117411:84 , srv1797277476:84 , srv1814349637:84 , srv1833924693:84 , srv1844477163:84 , srv1886842611:84 , srv1921776691:84 , srv1946569602:84 , srv1960398764:84 , srv1962063867:84 , srv1973786003:84 , srv2001292332:84 , srv2015420695:84 , srv208323664:84 , srv2088023219:84 , srv2109243443:84 , srv2217111:84 , srv268627423:84 , srv276180841:84 , srv294507443:84 , srv298043808:84 , srv303022009:84 , srv327173940:84 , srv384317384:84 , srv38667560:84 , srv397812252:84 , srv415532552:84 , srv427700371:84 , srv44840630:84 , srv457891423:84 , srv547950704:84 , srv556745253:84 , srv559073907:84 , srv580759313:84 , srv583916721:84 , srv591019957:84 , srv633066906:84 , srv655068756:84 , srv670799746:84 , srv678769356:84 , srv680911364:84 , srv68612194:84 , srv720501363:84 , srv7435876:84 , srv757417818:84 , srv761239963:84 , srv796699518:84 , srv827048686:84 , srv828079333:84 , srv910054734:84 , srv912083771:84 , srv927041179:84 , srv958385793:84 , srv958530646:84 , srv1152231099:85 , srv1210106798:85 , srv1468451196:85 , srv1541531481:85 , srv1596955912:85 , srv1714878740:85 , srv228556098:85 , srv977168668:684 }
2023-08-09 00:53:15,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:15,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv397812252=68, srv1797277476=42, srv1596955912=35, srv298043808=63, srv1667504371=37, srv1210106798=8, srv38667560=67, srv1962063867=51, srv1592369351=34, srv1946569602=49, srv457891423=72, srv1152231099=7, srv1814349637=43, srv958530646=98, srv1468531769=22, srv1468451196=21, srv912083771=95, srv1973786003=52, srv633066906=79, srv208323664=55, srv2109243443=57, srv1571536985=31, srv1328731101=15, srv1844477163=45, srv678769356=82, srv177627471=40, srv1141071374=6, srv910054734=94, srv580759313=76, srv796699518=91, srv958385793=97, srv1083459488=3, srv1833924693=44, srv2217111=58, srv1124789706=4, srv268627423=60, srv1574113102=32, srv303022009=64, srv1447304932=19, srv1501852826=24, srv154168072=28, srv2015420695=54, srv1794117411=41, srv1960398764=50, srv1022393368=0, srv327173940=65, srv583916721=77, srv765735096=90, srv1454234853=20, srv276180841=61, srv228556098=59, srv427700371=70, srv1252782987=10, srv415532552=69, srv1549371792=30, srv1886842611=46, srv143908624=18, srv1670945384=38, srv1135664793=5, srv655068756=80, srv1393862036=16, srv1921776691=48, srv927041179=96, srv977168668=99, srv559073907=75, srv670799746=81, srv44840630=71, srv1543640337=29, srv828079333=93, srv384317384=66, srv1322813062=14, srv2001292332=53, srv1898921449=47, srv1031719882=1, srv7435876=87, srv1231127044=9, srv696514445=85, srv1579517503=33, srv761239963=89, srv1503140746=25, srv1714878740=39, srv68612194=84, srv1514885872=26, srv2088023219=56, srv1541531481=27, srv757417818=88, srv720501363=86, srv294507443=62, srv1489887147=23, srv680911364=83, srv547950704=73, srv1050913649=2, srv1428993676=17, srv1280916884=11, srv591019957=78, srv827048686=92, srv1313072064=12, srv1316129808=13, srv1597465970=36, srv556745253=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-09 00:53:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-09 00:53:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-09 00:53:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-09 00:53:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-09 00:53:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-09 00:53:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-09 00:53:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-09 00:53:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-09 00:53:15,730 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:15,731 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1135664793:83 , srv1393862036:83 , srv1454234853:83 , srv1549371792:83 , srv1898921449:83 , srv696514445:83 , srv765735096:83 , srv1022393368:84 , srv1031719882:84 , srv1050913649:84 , srv1083459488:84 , srv1124789706:84 , srv1141071374:84 , srv1231127044:84 , srv1252782987:84 , srv1280916884:84 , srv1313072064:84 , srv1316129808:84 , srv1322813062:84 , srv1328731101:84 , srv1428993676:84 , srv143908624:84 , srv1447304932:84 , srv1468531769:84 , srv1489887147:84 , srv1501852826:84 , srv1503140746:84 , srv1514885872:84 , srv154168072:84 , srv1543640337:84 , srv1571536985:84 , srv1574113102:84 , srv1579517503:84 , srv1592369351:84 , srv1597465970:84 , srv1667504371:84 , srv1670945384:84 , srv177627471:84 , srv1794117411:84 , srv1797277476:84 , srv1814349637:84 , srv1833924693:84 , srv1844477163:84 , srv1886842611:84 , srv1921776691:84 , srv1946569602:84 , srv1960398764:84 , srv1962063867:84 , srv1973786003:84 , srv2001292332:84 , srv2015420695:84 , srv208323664:84 , srv2088023219:84 , srv2109243443:84 , srv2217111:84 , srv268627423:84 , srv276180841:84 , srv294507443:84 , srv298043808:84 , srv303022009:84 , srv327173940:84 , srv384317384:84 , srv38667560:84 , srv397812252:84 , srv415532552:84 , srv427700371:84 , srv44840630:84 , srv457891423:84 , srv547950704:84 , srv556745253:84 , srv559073907:84 , srv580759313:84 , srv583916721:84 , srv591019957:84 , srv633066906:84 , srv655068756:84 , srv670799746:84 , srv678769356:84 , srv680911364:84 , srv68612194:84 , srv720501363:84 , srv7435876:84 , srv757417818:84 , srv761239963:84 , srv796699518:84 , srv827048686:84 , srv828079333:84 , srv910054734:84 , srv912083771:84 , srv927041179:84 , srv958385793:84 , srv958530646:84 , srv1152231099:85 , srv1210106798:85 , srv1468451196:85 , srv1541531481:85 , srv1596955912:85 , srv1714878740:85 , srv228556098:85 , srv977168668:684 }
2023-08-09 00:53:15,765 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=2059 (was 2826)
2023-08-09 00:53:15,777 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=175, AvailableMemoryMB=2056
2023-08-09 00:53:15,777 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-09 00:53:15,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-09 00:53:15,790 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100499351:84 , srv1184359749:84 , srv1213600790:84 , srv1288674614:84 , srv1347225834:84 , srv1434894538:84 , srv1477737393:84 , srv150803003:84 , srv1541103782:84 , srv1594624752:84 , srv1651523461:84 , srv1663951470:84 , srv1664249848:84 , srv1753987193:84 , srv1832631033:84 , srv1836575053:84 , srv1867301631:84 , srv1874031165:84 , srv1979636448:84 , srv2004197328:84 , srv2043848828:84 , srv269780307:84 , srv451892896:84 , srv639460155:84 , srv741719403:84 , srv746874428:84 , srv775919074:84 , srv880136050:84 , srv977043170:84 , srv1624618776:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-09 00:53:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:53:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv451892896=23, srv1184359749=1, srv775919074=27, srv1874031165=18, srv2043848828=21, srv746874428=26, srv1288674614=3, srv977043170=29, srv1347225834=4, srv1664249848=13, srv1594624752=9, srv1541103782=8, srv1753987193=14, srv1867301631=17, srv1979636448=19, srv100499351=0, srv1434894538=5, srv150803003=7, srv1624618776=10, srv2004197328=20, srv1651523461=11, srv269780307=22, srv639460155=24, srv1663951470=12, srv1213600790=2, srv880136050=28, srv1836575053=16, srv741719403=25, srv1477737393=6, srv1832631033=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:53:15,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:53:15,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:53:15,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:53:15,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-09 00:53:15,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0978700013116773, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:53:15,833 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912501428442664, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0978700013116773, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-09 00:55:15,811 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5688262 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912501428442664 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:55:15,817 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv100499351:90 , srv1184359749:90 , srv1213600790:90 , srv1288674614:90 , srv1347225834:90 , srv1434894538:90 , srv1477737393:90 , srv150803003:90 , srv1541103782:90 , srv1594624752:90 , srv1624618776:90 , srv1651523461:90 , srv1663951470:90 , srv1664249848:90 , srv1753987193:90 , srv1832631033:90 , srv1836575053:90 , srv1867301631:90 , srv1874031165:90 , srv1979636448:90 , srv2004197328:90 , srv2043848828:90 , srv269780307:90 , srv451892896:90 , srv639460155:90 , srv741719403:90 , srv746874428:90 , srv775919074:90 , srv880136050:90 , srv977043170:90 }
2023-08-09 00:55:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-09 00:55:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv451892896=23, srv1184359749=1, srv775919074=27, srv1874031165=18, srv2043848828=21, srv746874428=26, srv1288674614=3, srv977043170=29, srv1347225834=4, srv1664249848=13, srv1594624752=9, srv1541103782=8, srv1753987193=14, srv1867301631=17, srv1979636448=19, srv100499351=0, srv1434894538=5, srv150803003=7, srv1624618776=10, srv2004197328=20, srv1651523461=11, srv269780307=22, srv639460155=24, srv1663951470=12, srv1213600790=2, srv880136050=28, srv1836575053=16, srv741719403=25, srv1477737393=6, srv1832631033=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-09 00:55:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-09 00:55:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-09 00:55:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-09 00:55:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-09 00:55:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-09 00:55:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-09 00:55:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-09 00:55:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-09 00:55:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-09 00:55:15,835 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-09 00:55:15,835 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv100499351:90 , srv1184359749:90 , srv1213600790:90 , srv1288674614:90 , srv1347225834:90 , srv1434894538:90 , srv1477737393:90 , srv150803003:90 , srv1541103782:90 , srv1594624752:90 , srv1624618776:90 , srv1651523461:90 , srv1663951470:90 , srv1664249848:90 , srv1753987193:90 , srv1832631033:90 , srv1836575053:90 , srv1867301631:90 , srv1874031165:90 , srv1979636448:90 , srv2004197328:90 , srv2043848828:90 , srv269780307:90 , srv451892896:90 , srv639460155:90 , srv741719403:90 , srv746874428:90 , srv775919074:90 , srv880136050:90 , srv977043170:90 }
2023-08-09 00:55:15,850 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 294), ProcessCount=171 (was 175), AvailableMemoryMB=1886 (was 2056)