2024-03-09 17:53:18,715 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-03-09 17:53:19,055 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-03-09 17:53:19,175 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-03-09 17:53:19,259 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-09 17:53:19,267 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-09 17:53:19,282 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=10689
2024-03-09 17:53:19,285 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-09 17:53:19,285 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-09 17:53:19,432 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010983559:84 , srv1057360297:84 , srv1057700174:84 , srv1082304250:84 , srv1130602790:84 , srv1132507665:84 , srv1136662614:84 , srv1168697789:84 , srv1200342714:84 , srv120562501:84 , srv1240656448:84 , srv1257164674:84 , srv1310037265:84 , srv1329556446:84 , srv1355347414:84 , srv1359194313:84 , srv1362188061:84 , srv1413993453:84 , srv1424584129:84 , srv1456998961:84 , srv1483223898:84 , srv1493853939:84 , srv1498828129:84 , srv1500291035:84 , srv1515838681:84 , srv1560301894:84 , srv1578197030:84 , srv1588017869:84 , srv1620629078:84 , srv1640619704:84 , srv165018196:84 , srv168440472:84 , srv1701461709:84 , srv1711471148:84 , srv1765537755:84 , srv1804791399:84 , srv1827534216:84 , srv1868946254:84 , srv1879203360:84 , srv1927976924:84 , srv1930519659:84 , srv1940205693:84 , srv1940794802:84 , srv1942213037:84 , srv1943340888:84 , srv1945794390:84 , srv1959272948:84 , srv1972041987:84 , srv1975608921:84 , srv2060519886:84 , srv2083463994:84 , srv2085539782:84 , srv2085744113:84 , srv2129521609:84 , srv2130751325:84 , srv219115200:84 , srv232537424:84 , srv232565232:84 , srv258835595:84 , srv261279913:84 , srv29576077:84 , srv306192476:84 , srv367912864:84 , srv377646318:84 , srv38316598:84 , srv420190581:84 , srv421919401:84 , srv426123441:84 , srv430256295:84 , srv433487960:84 , srv475859063:84 , srv478424890:84 , srv518071435:84 , srv540057366:84 , srv542798502:84 , srv572994719:84 , srv593834455:84 , srv600181341:84 , srv608989247:84 , srv612542246:84 , srv620442419:84 , srv633739783:84 , srv634750653:84 , srv64799659:84 , srv655749083:84 , srv692147611:84 , srv788140497:84 , srv814689270:84 , srv822360947:84 , srv838055725:84 , srv851709785:84 , srv860645387:84 , srv870225588:84 , srv893790223:84 , srv911923061:84 , srv913723942:84 , srv91860930:84 , srv9336828:84 , srv992918940:84 , srv1483670191:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-03-09 17:53:19,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:19,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1879203360=39, srv1082304250=3, srv1329556446=13, srv612542246=80, srv1620629078=29, srv475859063=71, srv860645387=92, srv1711471148=34, srv1640619704=30, srv822360947=89, srv421919401=67, srv1413993453=17, srv433487960=70, srv38316598=65, srv2085744113=53, srv232565232=58, srv1959272948=47, srv838055725=90, srv1940205693=42, srv870225588=93, srv1240656448=10, srv992918940=99, srv1483223898=20, srv1362188061=16, srv2085539782=52, srv120562501=9, srv572994719=76, srv377646318=64, srv1200342714=8, srv1493853939=22, srv1765537755=35, srv2130751325=55, srv219115200=56, srv655749083=85, srv1500291035=24, srv1257164674=11, srv29576077=61, srv851709785=91, srv1498828129=23, srv593834455=77, srv1168697789=7, srv518071435=73, srv1424584129=18, srv1804791399=36, srv261279913=60, srv1057700174=2, srv620442419=81, srv165018196=31, srv788140497=87, srv1057360297=1, srv1136662614=6, srv1483670191=21, srv1827534216=37, srv430256295=69, srv633739783=82, srv367912864=63, srv168440472=32, srv1010983559=0, srv420190581=66, srv1515838681=25, srv634750653=83, srv1578197030=27, srv306192476=62, srv1588017869=28, srv911923061=95, srv1130602790=4, srv1310037265=12, srv232537424=57, srv1355347414=14, srv1927976924=40, srv540057366=74, srv1943340888=45, srv426123441=68, srv1972041987=48, srv692147611=86, srv2083463994=51, srv1359194313=15, srv542798502=75, srv64799659=84, srv1456998961=19, srv2129521609=54, srv814689270=88, srv608989247=79, srv2060519886=50, srv1132507665=5, srv1942213037=44, srv913723942=96, srv1940794802=43, srv1868946254=38, srv1930519659=41, srv1975608921=49, srv893790223=94, srv478424890=72, srv1945794390=46, srv1701461709=33, srv258835595=59, srv1560301894=26, srv91860930=97, srv600181341=78, srv9336828=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:19,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:19,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:19,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:19,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:19,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:19,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:19,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-09 17:53:19,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-09 17:53:19,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-09 17:53:19,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-09 17:53:19,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-09 17:53:19,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-09 17:53:19,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-09 17:53:19,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-09 17:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-09 17:53:19,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-09 17:53:19,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-09 17:53:19,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-09 17:53:19,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-09 17:53:19,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-09 17:53:19,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-09 17:53:19,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-09 17:53:19,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-09 17:53:19,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-09 17:53:19,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-09 17:53:19,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-09 17:53:19,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-09 17:53:19,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-09 17:53:19,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-09 17:53:19,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-09 17:53:19,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-09 17:53:19,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-09 17:53:19,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-09 17:53:19,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:19,740 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-09 17:53:19,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-09 17:53:20,119 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 546 ms to try 5000 different iterations.  Found a solution that moves 4698 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17553065184719258. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04012015871794454, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0545998606330161, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.522, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04012015871794454, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17041666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:20,141 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2083463994:80 , srv692147611:81 , srv893790223:81 , srv1940205693:82 , srv1942213037:82 , srv2060519886:82 , srv219115200:82 , srv478424890:82 , srv633739783:82 , srv91860930:82 , srv1136662614:83 , srv1168697789:83 , srv165018196:83 , srv1940794802:83 , srv1945794390:83 , srv2085539782:83 , srv2085744113:83 , srv367912864:83 , srv572994719:83 , srv634750653:83 , srv851709785:83 , srv992918940:83 , srv120562501:84 , srv1355347414:84 , srv1578197030:84 , srv1701461709:84 , srv1959272948:84 , srv1975608921:84 , srv258835595:84 , srv1483223898:85 , srv1498828129:85 , srv232565232:85 , srv261279913:85 , srv420190581:85 , srv814689270:85 , srv870225588:85 , srv1493853939:86 , srv1500291035:86 , srv1515838681:86 , srv168440472:86 , srv1765537755:86 , srv1804791399:86 , srv1972041987:86 , srv540057366:86 , srv608989247:86 , srv64799659:86 , srv822360947:86 , srv860645387:86 , srv1130602790:87 , srv1310037265:87 , srv1329556446:87 , srv1424584129:87 , srv1456998961:87 , srv1620629078:87 , srv1640619704:87 , srv1868946254:87 , srv1927976924:87 , srv1943340888:87 , srv38316598:87 , srv421919401:87 , srv426123441:87 , srv430256295:87 , srv475859063:87 , srv593834455:87 , srv655749083:87 , srv9336828:87 , srv1057700174:88 , srv1132507665:88 , srv1200342714:88 , srv1240656448:88 , srv1257164674:88 , srv1413993453:88 , srv1560301894:88 , srv1588017869:88 , srv1711471148:88 , srv2130751325:88 , srv600181341:88 , srv612542246:88 , srv788140497:88 , srv838055725:88 , srv1082304250:89 , srv1362188061:89 , srv2129521609:89 , srv29576077:89 , srv433487960:89 , srv518071435:89 , srv542798502:89 , srv620442419:89 , srv911923061:89 , srv1879203360:90 , srv1930519659:90 , srv306192476:90 , srv1010983559:91 , srv1359194313:91 , srv1057360297:92 , srv913723942:92 , srv377646318:94 , srv1827534216:97 , srv232537424:101 , srv1483670191:446 }
2024-03-09 17:53:20,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:20,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1879203360=39, srv1082304250=3, srv1329556446=13, srv612542246=80, srv1620629078=29, srv475859063=71, srv860645387=92, srv1711471148=34, srv1640619704=30, srv822360947=89, srv421919401=67, srv1413993453=17, srv433487960=70, srv38316598=65, srv2085744113=53, srv232565232=58, srv1959272948=47, srv838055725=90, srv1940205693=42, srv870225588=93, srv1240656448=10, srv992918940=99, srv1483223898=20, srv1362188061=16, srv2085539782=52, srv120562501=9, srv572994719=76, srv377646318=64, srv1200342714=8, srv1493853939=22, srv1765537755=35, srv2130751325=55, srv219115200=56, srv655749083=85, srv1500291035=24, srv1257164674=11, srv29576077=61, srv851709785=91, srv1498828129=23, srv593834455=77, srv1168697789=7, srv518071435=73, srv1424584129=18, srv1804791399=36, srv261279913=60, srv1057700174=2, srv620442419=81, srv165018196=31, srv788140497=87, srv1057360297=1, srv1136662614=6, srv1483670191=21, srv1827534216=37, srv430256295=69, srv633739783=82, srv367912864=63, srv168440472=32, srv1010983559=0, srv420190581=66, srv1515838681=25, srv634750653=83, srv1578197030=27, srv306192476=62, srv1588017869=28, srv911923061=95, srv1130602790=4, srv1310037265=12, srv232537424=57, srv1355347414=14, srv1927976924=40, srv540057366=74, srv1943340888=45, srv426123441=68, srv1972041987=48, srv692147611=86, srv2083463994=51, srv1359194313=15, srv542798502=75, srv64799659=84, srv1456998961=19, srv2129521609=54, srv814689270=88, srv608989247=79, srv2060519886=50, srv1132507665=5, srv1942213037=44, srv913723942=96, srv1940794802=43, srv1868946254=38, srv1930519659=41, srv1975608921=49, srv893790223=94, srv478424890=72, srv1945794390=46, srv1701461709=33, srv258835595=59, srv1560301894=26, srv91860930=97, srv600181341=78, srv9336828=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:20,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-09 17:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-09 17:53:20,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-09 17:53:20,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-09 17:53:20,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-09 17:53:20,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-09 17:53:20,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-09 17:53:20,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-09 17:53:20,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-09 17:53:20,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04012015871794454, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0545998606330161, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04012015871794454, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17041666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:20,340 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-09 17:53:20,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17549775574809012, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04012015871794454, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0545998606330161, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04012015871794454, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17041666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-09 17:53:20,639 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 436 ms to try 5000 different iterations.  Found a solution that moves 2636 regions; Going from a computed imbalance of 0.17549775574809012 to a new imbalance of 0.013670186152246043. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022177845702524582); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03572246178658851, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29288888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022177845702524582); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0105); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:20,650 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv232537424:73 , srv1057360297:78 , srv1010983559:80 , srv913723942:80 , srv1827534216:81 , srv29576077:81 , srv306192476:81 , srv1057700174:82 , srv1132507665:82 , srv1200342714:82 , srv1362188061:82 , srv1413993453:82 , srv1879203360:82 , srv1930519659:82 , srv1082304250:83 , srv1240656448:83 , srv1588017869:83 , srv1868946254:83 , srv377646318:83 , srv426123441:83 , srv518071435:83 , srv542798502:83 , srv600181341:83 , srv620442419:83 , srv911923061:83 , srv1359194313:84 , srv1456998961:84 , srv1560301894:84 , srv1640619704:84 , srv1711471148:84 , srv2129521609:84 , srv2130751325:84 , srv38316598:84 , srv433487960:84 , srv612542246:84 , srv788140497:84 , srv822360947:84 , srv838055725:84 , srv120562501:85 , srv1257164674:85 , srv1500291035:85 , srv1578197030:85 , srv1620629078:85 , srv168440472:85 , srv1804791399:85 , srv1927976924:85 , srv1943340888:85 , srv1972041987:85 , srv421919401:85 , srv540057366:85 , srv593834455:85 , srv1310037265:86 , srv1493853939:86 , srv1959272948:86 , srv232565232:86 , srv258835595:86 , srv261279913:86 , srv430256295:86 , srv64799659:86 , srv655749083:86 , srv1130602790:87 , srv1329556446:87 , srv1424584129:87 , srv1483223898:87 , srv165018196:87 , srv1765537755:87 , srv420190581:87 , srv634750653:87 , srv814689270:87 , srv860645387:87 , srv9336828:87 , srv1168697789:88 , srv1355347414:88 , srv1515838681:88 , srv1701461709:88 , srv1945794390:88 , srv1975608921:88 , srv475859063:88 , srv608989247:88 , srv870225588:88 , srv91860930:88 , srv1136662614:89 , srv1498828129:89 , srv1940205693:89 , srv1940794802:89 , srv367912864:89 , srv992918940:89 , srv2083463994:90 , srv2085744113:90 , srv219115200:90 , srv851709785:90 , srv2085539782:91 , srv478424890:91 , srv572994719:91 , srv633739783:91 , srv692147611:91 , srv1942213037:92 , srv2060519886:92 , srv893790223:93 , srv1483670191:525 }
2024-03-09 17:53:20,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:20,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1879203360=39, srv1082304250=3, srv1329556446=13, srv612542246=80, srv1620629078=29, srv475859063=71, srv860645387=92, srv1711471148=34, srv1640619704=30, srv822360947=89, srv421919401=67, srv1413993453=17, srv433487960=70, srv38316598=65, srv2085744113=53, srv232565232=58, srv1959272948=47, srv838055725=90, srv1940205693=42, srv870225588=93, srv1240656448=10, srv992918940=99, srv1483223898=20, srv1362188061=16, srv2085539782=52, srv120562501=9, srv572994719=76, srv377646318=64, srv1200342714=8, srv1493853939=22, srv1765537755=35, srv2130751325=55, srv219115200=56, srv655749083=85, srv1500291035=24, srv1257164674=11, srv29576077=61, srv851709785=91, srv1498828129=23, srv593834455=77, srv1168697789=7, srv518071435=73, srv1424584129=18, srv1804791399=36, srv261279913=60, srv1057700174=2, srv620442419=81, srv165018196=31, srv788140497=87, srv1057360297=1, srv1136662614=6, srv1483670191=21, srv1827534216=37, srv430256295=69, srv633739783=82, srv367912864=63, srv168440472=32, srv1010983559=0, srv420190581=66, srv1515838681=25, srv634750653=83, srv1578197030=27, srv306192476=62, srv1588017869=28, srv911923061=95, srv1130602790=4, srv1310037265=12, srv232537424=57, srv1355347414=14, srv1927976924=40, srv540057366=74, srv1943340888=45, srv426123441=68, srv1972041987=48, srv692147611=86, srv2083463994=51, srv1359194313=15, srv542798502=75, srv64799659=84, srv1456998961=19, srv2129521609=54, srv814689270=88, srv608989247=79, srv2060519886=50, srv1132507665=5, srv1942213037=44, srv913723942=96, srv1940794802=43, srv1868946254=38, srv1930519659=41, srv1975608921=49, srv893790223=94, srv478424890=72, srv1945794390=46, srv1701461709=33, srv258835595=59, srv1560301894=26, srv91860930=97, srv600181341=78, srv9336828=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:20,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:20,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:20,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:20,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-09 17:53:20,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-09 17:53:20,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-09 17:53:20,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-09 17:53:20,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-09 17:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-09 17:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-09 17:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-09 17:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-09 17:53:20,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022177845702524582); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03572246178658851, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022177845702524582); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0105); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:20,814 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-09 17:53:20,815 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013651728485742427, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022177845702524582); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03572246178658851, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022177845702524582); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0105); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-09 17:53:21,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 523 ms to try 5000 different iterations.  Found a solution that moves 1007 regions; Going from a computed imbalance of 0.013651728485742427 to a new imbalance of 9.308116002304474E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007324451309205373); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.014046579558967275); MoveCostFunction : (multiplier=7.0, imbalance=0.11188888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007324451309205373); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:21,233 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1827534216:80 , srv377646318:80 , srv1359194313:82 , srv2060519886:82 , srv1130602790:83 , srv1498828129:83 , srv475859063:83 , srv608989247:83 , srv9336828:83 , srv1310037265:84 , srv1329556446:84 , srv1424584129:84 , srv1515838681:84 , srv1560301894:84 , srv1930519659:84 , srv1942213037:84 , srv2085539782:84 , srv2129521609:84 , srv232537424:84 , srv430256295:84 , srv433487960:84 , srv478424890:84 , srv572994719:84 , srv633739783:84 , srv655749083:84 , srv814689270:84 , srv851709785:84 , srv860645387:84 , srv893790223:84 , srv1082304250:85 , srv1136662614:85 , srv1257164674:85 , srv1355347414:85 , srv1493853939:85 , srv1701461709:85 , srv1711471148:85 , srv1765537755:85 , srv1940205693:85 , srv2085744113:85 , srv2130751325:85 , srv421919401:85 , srv518071435:85 , srv542798502:85 , srv620442419:85 , srv692147611:85 , srv788140497:85 , srv838055725:85 , srv870225588:85 , srv911923061:85 , srv1010983559:86 , srv1168697789:86 , srv1240656448:86 , srv1456998961:86 , srv1483223898:86 , srv1500291035:86 , srv1620629078:86 , srv1640619704:86 , srv168440472:86 , srv1804791399:86 , srv1879203360:86 , srv1927976924:86 , srv1940794802:86 , srv1943340888:86 , srv1945794390:86 , srv1972041987:86 , srv1975608921:86 , srv219115200:86 , srv258835595:86 , srv367912864:86 , srv38316598:86 , srv420190581:86 , srv593834455:86 , srv612542246:86 , srv64799659:86 , srv913723942:86 , srv992918940:86 , srv1057360297:87 , srv1200342714:87 , srv1362188061:87 , srv1413993453:87 , srv1588017869:87 , srv165018196:87 , srv1868946254:87 , srv232565232:87 , srv261279913:87 , srv29576077:87 , srv306192476:87 , srv426123441:87 , srv540057366:87 , srv600181341:87 , srv634750653:87 , srv822360947:87 , srv91860930:87 , srv1057700174:88 , srv1132507665:88 , srv120562501:88 , srv1578197030:88 , srv1959272948:88 , srv2083463994:88 , srv1483670191:552 }
2024-03-09 17:53:21,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:21,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1879203360=39, srv1082304250=3, srv1329556446=13, srv612542246=80, srv1620629078=29, srv475859063=71, srv860645387=92, srv1711471148=34, srv1640619704=30, srv822360947=89, srv421919401=67, srv1413993453=17, srv433487960=70, srv38316598=65, srv2085744113=53, srv232565232=58, srv1959272948=47, srv838055725=90, srv1940205693=42, srv870225588=93, srv1240656448=10, srv992918940=99, srv1483223898=20, srv1362188061=16, srv2085539782=52, srv120562501=9, srv572994719=76, srv377646318=64, srv1200342714=8, srv1493853939=22, srv1765537755=35, srv2130751325=55, srv219115200=56, srv655749083=85, srv1500291035=24, srv1257164674=11, srv29576077=61, srv851709785=91, srv1498828129=23, srv593834455=77, srv1168697789=7, srv518071435=73, srv1424584129=18, srv1804791399=36, srv261279913=60, srv1057700174=2, srv620442419=81, srv165018196=31, srv788140497=87, srv1057360297=1, srv1136662614=6, srv1483670191=21, srv1827534216=37, srv430256295=69, srv633739783=82, srv367912864=63, srv168440472=32, srv1010983559=0, srv420190581=66, srv1515838681=25, srv634750653=83, srv1578197030=27, srv306192476=62, srv1588017869=28, srv911923061=95, srv1130602790=4, srv1310037265=12, srv232537424=57, srv1355347414=14, srv1927976924=40, srv540057366=74, srv1943340888=45, srv426123441=68, srv1972041987=48, srv692147611=86, srv2083463994=51, srv1359194313=15, srv542798502=75, srv64799659=84, srv1456998961=19, srv2129521609=54, srv814689270=88, srv608989247=79, srv2060519886=50, srv1132507665=5, srv1942213037=44, srv913723942=96, srv1940794802=43, srv1868946254=38, srv1930519659=41, srv1975608921=49, srv893790223=94, srv478424890=72, srv1945794390=46, srv1701461709=33, srv258835595=59, srv1560301894=26, srv91860930=97, srv600181341=78, srv9336828=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:21,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:21,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:21,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:21,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-09 17:53:21,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-09 17:53:21,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-09 17:53:21,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-09 17:53:21,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-09 17:53:21,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-09 17:53:21,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-09 17:53:21,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-09 17:53:21,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-09 17:53:21,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007324451309205373); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.014046579558967275); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007324451309205373); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:21,406 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-09 17:53:21,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.237604355228821E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007324451309205373); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.014046579558967275); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007324451309205373); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-09 17:53:21,656 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 364 ms to try 5000 different iterations.  Found a solution that moves 294 regions; Going from a computed imbalance of 9.237604355228821E-4 to a new imbalance of 4.5672269761188647E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.03266666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:21,657 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1483223898:83 , srv1620629078:83 , srv1057700174:84 , srv1082304250:84 , srv1132507665:84 , srv1168697789:84 , srv1257164674:84 , srv1329556446:84 , srv1362188061:84 , srv1515838681:84 , srv1578197030:84 , srv1765537755:84 , srv1879203360:84 , srv1927976924:84 , srv1940794802:84 , srv1942213037:84 , srv1943340888:84 , srv1959272948:84 , srv1975608921:84 , srv2083463994:84 , srv2085744113:84 , srv232537424:84 , srv261279913:84 , srv29576077:84 , srv306192476:84 , srv367912864:84 , srv38316598:84 , srv420190581:84 , srv540057366:84 , srv593834455:84 , srv600181341:84 , srv612542246:84 , srv634750653:84 , srv64799659:84 , srv870225588:84 , srv893790223:84 , srv913723942:84 , srv91860930:84 , srv992918940:84 , srv1010983559:85 , srv1057360297:85 , srv1130602790:85 , srv1136662614:85 , srv1200342714:85 , srv120562501:85 , srv1240656448:85 , srv1310037265:85 , srv1355347414:85 , srv1359194313:85 , srv1413993453:85 , srv1424584129:85 , srv1456998961:85 , srv1493853939:85 , srv1498828129:85 , srv1500291035:85 , srv1588017869:85 , srv1640619704:85 , srv165018196:85 , srv1701461709:85 , srv1711471148:85 , srv1804791399:85 , srv1827534216:85 , srv1868946254:85 , srv1930519659:85 , srv1945794390:85 , srv1972041987:85 , srv2085539782:85 , srv2129521609:85 , srv2130751325:85 , srv219115200:85 , srv232565232:85 , srv377646318:85 , srv421919401:85 , srv426123441:85 , srv430256295:85 , srv433487960:85 , srv475859063:85 , srv478424890:85 , srv518071435:85 , srv542798502:85 , srv572994719:85 , srv608989247:85 , srv620442419:85 , srv633739783:85 , srv655749083:85 , srv692147611:85 , srv822360947:85 , srv838055725:85 , srv860645387:85 , srv911923061:85 , srv9336828:85 , srv1560301894:86 , srv168440472:86 , srv1940205693:86 , srv2060519886:86 , srv258835595:86 , srv788140497:86 , srv814689270:86 , srv851709785:86 , srv1483670191:618 }
2024-03-09 17:53:21,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:21,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1879203360=39, srv1082304250=3, srv1329556446=13, srv612542246=80, srv1620629078=29, srv475859063=71, srv860645387=92, srv1711471148=34, srv1640619704=30, srv822360947=89, srv421919401=67, srv1413993453=17, srv433487960=70, srv38316598=65, srv2085744113=53, srv232565232=58, srv1959272948=47, srv838055725=90, srv1940205693=42, srv870225588=93, srv1240656448=10, srv992918940=99, srv1483223898=20, srv1362188061=16, srv2085539782=52, srv120562501=9, srv572994719=76, srv377646318=64, srv1200342714=8, srv1493853939=22, srv1765537755=35, srv2130751325=55, srv219115200=56, srv655749083=85, srv1500291035=24, srv1257164674=11, srv29576077=61, srv851709785=91, srv1498828129=23, srv593834455=77, srv1168697789=7, srv518071435=73, srv1424584129=18, srv1804791399=36, srv261279913=60, srv1057700174=2, srv620442419=81, srv165018196=31, srv788140497=87, srv1057360297=1, srv1136662614=6, srv1483670191=21, srv1827534216=37, srv430256295=69, srv633739783=82, srv367912864=63, srv168440472=32, srv1010983559=0, srv420190581=66, srv1515838681=25, srv634750653=83, srv1578197030=27, srv306192476=62, srv1588017869=28, srv911923061=95, srv1130602790=4, srv1310037265=12, srv232537424=57, srv1355347414=14, srv1927976924=40, srv540057366=74, srv1943340888=45, srv426123441=68, srv1972041987=48, srv692147611=86, srv2083463994=51, srv1359194313=15, srv542798502=75, srv64799659=84, srv1456998961=19, srv2129521609=54, srv814689270=88, srv608989247=79, srv2060519886=50, srv1132507665=5, srv1942213037=44, srv913723942=96, srv1940794802=43, srv1868946254=38, srv1930519659=41, srv1975608921=49, srv893790223=94, srv478424890=72, srv1945794390=46, srv1701461709=33, srv258835595=59, srv1560301894=26, srv91860930=97, srv600181341=78, srv9336828=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:21,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:21,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-09 17:53:21,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-09 17:53:21,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-09 17:53:21,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-09 17:53:21,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-09 17:53:21,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-09 17:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-09 17:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-09 17:53:21,816 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:21,816 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-09 17:53:21,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.361363776116464E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-09 17:53:22,034 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 41 regions; Going from a computed imbalance of 4.361363776116464E-5 to a new imbalance of 8.266778253098357E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.004555555555555556); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:22,035 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1424584129:83 , srv1588017869:83 , srv168440472:83 , srv1827534216:83 , srv2085539782:83 , srv219115200:83 , srv232565232:83 , srv475859063:83 , srv572994719:83 , srv788140497:83 , srv851709785:83 , srv1010983559:84 , srv1057360297:84 , srv1057700174:84 , srv1130602790:84 , srv1132507665:84 , srv1136662614:84 , srv1200342714:84 , srv120562501:84 , srv1240656448:84 , srv1257164674:84 , srv1310037265:84 , srv1329556446:84 , srv1355347414:84 , srv1359194313:84 , srv1362188061:84 , srv1413993453:84 , srv1456998961:84 , srv1493853939:84 , srv1498828129:84 , srv1500291035:84 , srv1515838681:84 , srv1560301894:84 , srv1640619704:84 , srv165018196:84 , srv1701461709:84 , srv1711471148:84 , srv1765537755:84 , srv1804791399:84 , srv1868946254:84 , srv1879203360:84 , srv1927976924:84 , srv1940205693:84 , srv1940794802:84 , srv1942213037:84 , srv1943340888:84 , srv1945794390:84 , srv1959272948:84 , srv1972041987:84 , srv1975608921:84 , srv2060519886:84 , srv2083463994:84 , srv2085744113:84 , srv2129521609:84 , srv2130751325:84 , srv232537424:84 , srv258835595:84 , srv261279913:84 , srv306192476:84 , srv367912864:84 , srv377646318:84 , srv420190581:84 , srv421919401:84 , srv426123441:84 , srv430256295:84 , srv433487960:84 , srv478424890:84 , srv518071435:84 , srv540057366:84 , srv542798502:84 , srv593834455:84 , srv600181341:84 , srv608989247:84 , srv612542246:84 , srv620442419:84 , srv633739783:84 , srv64799659:84 , srv655749083:84 , srv692147611:84 , srv814689270:84 , srv822360947:84 , srv838055725:84 , srv860645387:84 , srv870225588:84 , srv893790223:84 , srv911923061:84 , srv913723942:84 , srv9336828:84 , srv992918940:84 , srv1082304250:85 , srv1168697789:85 , srv1483223898:85 , srv1578197030:85 , srv1620629078:85 , srv1930519659:85 , srv29576077:85 , srv38316598:85 , srv634750653:85 , srv91860930:85 , srv1483670191:685 }
2024-03-09 17:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1879203360=39, srv1082304250=3, srv1329556446=13, srv612542246=80, srv1620629078=29, srv475859063=71, srv860645387=92, srv1711471148=34, srv1640619704=30, srv822360947=89, srv421919401=67, srv1413993453=17, srv433487960=70, srv38316598=65, srv2085744113=53, srv232565232=58, srv1959272948=47, srv838055725=90, srv1940205693=42, srv870225588=93, srv1240656448=10, srv992918940=99, srv1483223898=20, srv1362188061=16, srv2085539782=52, srv120562501=9, srv572994719=76, srv377646318=64, srv1200342714=8, srv1493853939=22, srv1765537755=35, srv2130751325=55, srv219115200=56, srv655749083=85, srv1500291035=24, srv1257164674=11, srv29576077=61, srv851709785=91, srv1498828129=23, srv593834455=77, srv1168697789=7, srv518071435=73, srv1424584129=18, srv1804791399=36, srv261279913=60, srv1057700174=2, srv620442419=81, srv165018196=31, srv788140497=87, srv1057360297=1, srv1136662614=6, srv1483670191=21, srv1827534216=37, srv430256295=69, srv633739783=82, srv367912864=63, srv168440472=32, srv1010983559=0, srv420190581=66, srv1515838681=25, srv634750653=83, srv1578197030=27, srv306192476=62, srv1588017869=28, srv911923061=95, srv1130602790=4, srv1310037265=12, srv232537424=57, srv1355347414=14, srv1927976924=40, srv540057366=74, srv1943340888=45, srv426123441=68, srv1972041987=48, srv692147611=86, srv2083463994=51, srv1359194313=15, srv542798502=75, srv64799659=84, srv1456998961=19, srv2129521609=54, srv814689270=88, srv608989247=79, srv2060519886=50, srv1132507665=5, srv1942213037=44, srv913723942=96, srv1940794802=43, srv1868946254=38, srv1930519659=41, srv1975608921=49, srv893790223=94, srv478424890=72, srv1945794390=46, srv1701461709=33, srv258835595=59, srv1560301894=26, srv91860930=97, srv600181341=78, srv9336828=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:22,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-09 17:53:22,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-09 17:53:22,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-09 17:53:22,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-09 17:53:22,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-09 17:53:22,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-09 17:53:22,181 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:22,181 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1424584129:83 , srv1588017869:83 , srv168440472:83 , srv1827534216:83 , srv2085539782:83 , srv219115200:83 , srv232565232:83 , srv475859063:83 , srv572994719:83 , srv788140497:83 , srv851709785:83 , srv1010983559:84 , srv1057360297:84 , srv1057700174:84 , srv1130602790:84 , srv1132507665:84 , srv1136662614:84 , srv1200342714:84 , srv120562501:84 , srv1240656448:84 , srv1257164674:84 , srv1310037265:84 , srv1329556446:84 , srv1355347414:84 , srv1359194313:84 , srv1362188061:84 , srv1413993453:84 , srv1456998961:84 , srv1493853939:84 , srv1498828129:84 , srv1500291035:84 , srv1515838681:84 , srv1560301894:84 , srv1640619704:84 , srv165018196:84 , srv1701461709:84 , srv1711471148:84 , srv1765537755:84 , srv1804791399:84 , srv1868946254:84 , srv1879203360:84 , srv1927976924:84 , srv1940205693:84 , srv1940794802:84 , srv1942213037:84 , srv1943340888:84 , srv1945794390:84 , srv1959272948:84 , srv1972041987:84 , srv1975608921:84 , srv2060519886:84 , srv2083463994:84 , srv2085744113:84 , srv2129521609:84 , srv2130751325:84 , srv232537424:84 , srv258835595:84 , srv261279913:84 , srv306192476:84 , srv367912864:84 , srv377646318:84 , srv420190581:84 , srv421919401:84 , srv426123441:84 , srv430256295:84 , srv433487960:84 , srv478424890:84 , srv518071435:84 , srv540057366:84 , srv542798502:84 , srv593834455:84 , srv600181341:84 , srv608989247:84 , srv612542246:84 , srv620442419:84 , srv633739783:84 , srv64799659:84 , srv655749083:84 , srv692147611:84 , srv814689270:84 , srv822360947:84 , srv838055725:84 , srv860645387:84 , srv870225588:84 , srv893790223:84 , srv911923061:84 , srv913723942:84 , srv9336828:84 , srv992918940:84 , srv1082304250:85 , srv1168697789:85 , srv1483223898:85 , srv1578197030:85 , srv1620629078:85 , srv1930519659:85 , srv29576077:85 , srv38316598:85 , srv634750653:85 , srv91860930:85 , srv1483670191:685 }
2024-03-09 17:53:22,211 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 303), ProcessCount=170 (was 170), AvailableMemoryMB=9905 (was 10689)
2024-03-09 17:53:22,220 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=9905
2024-03-09 17:53:22,221 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-09 17:53:22,222 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-03-09 17:53:22,239 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022748357:84 , srv1036853034:84 , srv105639527:84 , srv1083065841:84 , srv1085676582:84 , srv1133582342:84 , srv1268651088:84 , srv1287989123:84 , srv1379200721:84 , srv1492775235:84 , srv1701496788:84 , srv1867153413:84 , srv1907821683:84 , srv1954976658:84 , srv2026939470:84 , srv2138463639:84 , srv236570875:84 , srv248390108:84 , srv330483693:84 , srv33765998:84 , srv36260121:84 , srv367659626:84 , srv402063947:84 , srv571870016:84 , srv621805226:84 , srv689281264:84 , srv716488987:84 , srv789572489:84 , srv931980349:84 , srv97766452:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-03-09 17:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2026939470=14, srv402063947=22, srv716488987=26, srv789572489=27, srv1701496788=10, srv1907821683=12, srv1954976658=13, srv97766452=29, srv236570875=16, srv36260121=20, srv571870016=23, srv1022748357=0, srv33765998=19, srv1083065841=3, srv1268651088=6, srv330483693=18, srv1036853034=1, srv621805226=24, srv689281264=25, srv1287989123=7, srv105639527=2, srv1133582342=5, srv1867153413=11, srv248390108=17, srv1085676582=4, srv1379200721=8, srv1492775235=9, srv2138463639=15, srv367659626=21, srv931980349=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:53:22,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:53:22,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-09 17:53:22,270 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.109207544902635, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:53:22,270 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912537152672314, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.109207544902635, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-03-09 17:55:22,259 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6050084 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912537152672314 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:55:22,266 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1022748357:90 , srv1036853034:90 , srv105639527:90 , srv1083065841:90 , srv1085676582:90 , srv1133582342:90 , srv1268651088:90 , srv1287989123:90 , srv1379200721:90 , srv1492775235:90 , srv1701496788:90 , srv1867153413:90 , srv1907821683:90 , srv1954976658:90 , srv2026939470:90 , srv2138463639:90 , srv236570875:90 , srv248390108:90 , srv330483693:90 , srv33765998:90 , srv36260121:90 , srv367659626:90 , srv402063947:90 , srv571870016:90 , srv621805226:90 , srv689281264:90 , srv716488987:90 , srv789572489:90 , srv931980349:90 , srv97766452:90 }
2024-03-09 17:55:22,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-09 17:55:22,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2026939470=14, srv402063947=22, srv716488987=26, srv789572489=27, srv1701496788=10, srv1907821683=12, srv1954976658=13, srv97766452=29, srv236570875=16, srv36260121=20, srv571870016=23, srv1022748357=0, srv33765998=19, srv1083065841=3, srv1268651088=6, srv330483693=18, srv1036853034=1, srv621805226=24, srv689281264=25, srv1287989123=7, srv105639527=2, srv1133582342=5, srv1867153413=11, srv248390108=17, srv1085676582=4, srv1379200721=8, srv1492775235=9, srv2138463639=15, srv367659626=21, srv931980349=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-09 17:55:22,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-09 17:55:22,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-09 17:55:22,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-09 17:55:22,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-09 17:55:22,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-09 17:55:22,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-09 17:55:22,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-09 17:55:22,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-09 17:55:22,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-09 17:55:22,284 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-09 17:55:22,285 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1022748357:90 , srv1036853034:90 , srv105639527:90 , srv1083065841:90 , srv1085676582:90 , srv1133582342:90 , srv1268651088:90 , srv1287989123:90 , srv1379200721:90 , srv1492775235:90 , srv1701496788:90 , srv1867153413:90 , srv1907821683:90 , srv1954976658:90 , srv2026939470:90 , srv2138463639:90 , srv236570875:90 , srv248390108:90 , srv330483693:90 , srv33765998:90 , srv36260121:90 , srv367659626:90 , srv402063947:90 , srv571870016:90 , srv621805226:90 , srv689281264:90 , srv716488987:90 , srv789572489:90 , srv931980349:90 , srv97766452:90 }
2024-03-09 17:55:22,301 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 303), ProcessCount=168 (was 170), AvailableMemoryMB=9185 (was 9905)