2023-03-29 06:56:01,538 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-29 06:56:01,895 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-29 06:56:02,037 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-29 06:56:02,116 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-29 06:56:02,125 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-29 06:56:02,144 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=404, ProcessCount=172, AvailableMemoryMB=7970
2023-03-29 06:56:02,147 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-29 06:56:02,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-29 06:56:02,325 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1039113727:84 , srv1056108273:84 , srv1070221841:84 , srv1102313235:84 , srv1107176867:84 , srv1110264479:84 , srv1152043363:84 , srv1158705569:84 , srv116264608:84 , srv1168324892:84 , srv1171923453:84 , srv1193186845:84 , srv1205477045:84 , srv1212999851:84 , srv127422241:84 , srv1342254449:84 , srv1368793256:84 , srv1381892526:84 , srv1388813871:84 , srv1404156294:84 , srv1414481401:84 , srv1422670098:84 , srv1430923724:84 , srv1433631967:84 , srv1435139894:84 , srv147575142:84 , srv1507764700:84 , srv1545411568:84 , srv1551865387:84 , srv1583280730:84 , srv1591872976:84 , srv1601984375:84 , srv1628809132:84 , srv1631685919:84 , srv1652319947:84 , srv1672077392:84 , srv1680387338:84 , srv168060734:84 , srv1688479337:84 , srv1708972144:84 , srv1776803839:84 , srv1778205700:84 , srv1779748749:84 , srv1806718871:84 , srv1815392482:84 , srv1893956237:84 , srv1896584379:84 , srv1916772696:84 , srv1920825851:84 , srv1930219926:84 , srv1976756209:84 , srv1987002520:84 , srv1991449513:84 , srv2076664885:84 , srv2078686269:84 , srv2084221997:84 , srv2089168604:84 , srv2096789282:84 , srv2097229431:84 , srv2123811428:84 , srv254947613:84 , srv269559373:84 , srv274549146:84 , srv275551150:84 , srv282321757:84 , srv311857740:84 , srv323618402:84 , srv337057280:84 , srv387852791:84 , srv403995596:84 , srv406721490:84 , srv414570368:84 , srv443357238:84 , srv447707424:84 , srv459541896:84 , srv470704403:84 , srv487873992:84 , srv491649589:84 , srv498721045:84 , srv534033821:84 , srv556874958:84 , srv56938768:84 , srv578449451:84 , srv580752545:84 , srv586186824:84 , srv604867768:84 , srv616194164:84 , srv643824780:84 , srv678028251:84 , srv688680994:84 , srv68969793:84 , srv700227203:84 , srv754300492:84 , srv806356522:84 , srv812924502:84 , srv880006887:84 , srv905220990:84 , srv958805879:84 , srv974116142:84 , srv355143102:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-29 06:56:02,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:02,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688479337=38, srv1342254449=15, srv806356522=94, srv580752545=84, srv1193186845=11, srv1171923453=10, srv1628809132=32, srv2089168604=56, srv688680994=90, srv2123811428=59, srv1776803839=40, srv387852791=69, srv1591872976=30, srv754300492=93, srv1778205700=41, srv254947613=60, srv1672077392=35, srv443357238=73, srv1205477045=12, srv678028251=89, srv1414481401=20, srv1583280730=29, srv323618402=66, srv1806718871=43, srv403995596=70, srv958805879=98, srv1601984375=31, srv147575142=25, srv127422241=14, srv282321757=64, srv2084221997=55, srv2096789282=57, srv1430923724=22, srv604867768=86, srv905220990=97, srv1168324892=9, srv1916772696=47, srv2097229431=58, srv168060734=37, srv1070221841=2, srv1158705569=7, srv116264608=8, srv1652319947=34, srv1507764700=26, srv1422670098=21, srv414570368=72, srv1545411568=27, srv2078686269=54, srv1779748749=42, srv337057280=67, srv1893956237=45, srv275551150=63, srv586186824=85, srv974116142=99, srv487873992=77, srv274549146=62, srv406721490=71, srv470704403=76, srv1708972144=39, srv1991449513=52, srv498721045=79, srv269559373=61, srv56938768=82, srv491649589=78, srv1152043363=6, srv1920825851=48, srv447707424=74, srv1404156294=19, srv578449451=83, srv1107176867=4, srv1102313235=3, srv1212999851=13, srv1368793256=16, srv1435139894=24, srv700227203=92, srv68969793=91, srv534033821=80, srv355143102=68, srv1896584379=46, srv1039113727=0, srv1815392482=44, srv1930219926=49, srv459541896=75, srv880006887=96, srv1987002520=51, srv616194164=87, srv1388813871=18, srv1976756209=50, srv556874958=81, srv2076664885=53, srv643824780=88, srv1631685919=33, srv1381892526=17, srv1110264479=5, srv311857740=65, srv1680387338=36, srv812924502=95, srv1056108273=1, srv1433631967=23, srv1551865387=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:02,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:02,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:02,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:02,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:02,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:02,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:02,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:02,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:02,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:02,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:02,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:02,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:02,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:02,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:02,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:02,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:02,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:02,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-29 06:56:02,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-29 06:56:02,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-29 06:56:02,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-29 06:56:02,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-29 06:56:02,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-29 06:56:02,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-29 06:56:02,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-29 06:56:02,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-29 06:56:02,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-29 06:56:02,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-29 06:56:02,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-29 06:56:02,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-29 06:56:02,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-29 06:56:02,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-29 06:56:02,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-29 06:56:02,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-29 06:56:02,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-29 06:56:02,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-29 06:56:02,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-29 06:56:02,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-29 06:56:02,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-29 06:56:02,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-29 06:56:02,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-29 06:56:02,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-29 06:56:02,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-29 06:56:02,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-29 06:56:02,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-29 06:56:02,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-29 06:56:02,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-29 06:56:02,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-29 06:56:02,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-29 06:56:02,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-29 06:56:02,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-29 06:56:02,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-29 06:56:02,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-29 06:56:02,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-29 06:56:02,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-29 06:56:02,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-29 06:56:02,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-29 06:56:02,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:02,770 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-29 06:56:02,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-29 06:56:03,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 582 ms to try 5000 different iterations.  Found a solution that moves 4697 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1763182920605577. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03940700235228906, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05367525079307235, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5218888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03940700235228906, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17116666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:03,161 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2084221997:82 , srv447707424:82 , srv1102313235:83 , srv1168324892:83 , srv1433631967:83 , srv1507764700:83 , srv1545411568:83 , srv2123811428:83 , srv269559373:83 , srv688680994:83 , srv754300492:83 , srv1039113727:84 , srv1205477045:84 , srv1212999851:84 , srv1342254449:84 , srv1930219926:84 , srv1976756209:84 , srv2078686269:84 , srv2097229431:84 , srv282321757:84 , srv586186824:84 , srv678028251:84 , srv68969793:84 , srv1422670098:85 , srv1672077392:85 , srv311857740:85 , srv337057280:85 , srv443357238:85 , srv487873992:85 , srv498721045:85 , srv56938768:85 , srv580752545:85 , srv604867768:85 , srv643824780:85 , srv1110264479:86 , srv116264608:86 , srv1171923453:86 , srv1368793256:86 , srv1404156294:86 , srv1430923724:86 , srv1583280730:86 , srv1631685919:86 , srv1680387338:86 , srv1916772696:86 , srv1920825851:86 , srv1987002520:86 , srv1991449513:86 , srv2076664885:86 , srv387852791:86 , srv403995596:86 , srv459541896:86 , srv880006887:86 , srv905220990:86 , srv1056108273:87 , srv1152043363:87 , srv1158705569:87 , srv127422241:87 , srv1381892526:87 , srv1601984375:87 , srv1688479337:87 , srv1708972144:87 , srv1778205700:87 , srv1815392482:87 , srv1893956237:87 , srv1896584379:87 , srv254947613:87 , srv323618402:87 , srv406721490:87 , srv534033821:87 , srv812924502:87 , srv958805879:87 , srv1070221841:88 , srv1107176867:88 , srv1193186845:88 , srv1414481401:88 , srv1435139894:88 , srv147575142:88 , srv1628809132:88 , srv1779748749:88 , srv470704403:88 , srv556874958:88 , srv578449451:88 , srv700227203:88 , srv1388813871:89 , srv1551865387:89 , srv1776803839:89 , srv2089168604:89 , srv274549146:89 , srv414570368:89 , srv491649589:89 , srv616194164:89 , srv974116142:89 , srv1591872976:90 , srv275551150:90 , srv168060734:91 , srv1806718871:91 , srv2096789282:91 , srv806356522:91 , srv1652319947:105 , srv355143102:440 }
2023-03-29 06:56:03,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:03,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688479337=38, srv1342254449=15, srv806356522=94, srv580752545=84, srv1193186845=11, srv1171923453=10, srv1628809132=32, srv2089168604=56, srv688680994=90, srv2123811428=59, srv1776803839=40, srv387852791=69, srv1591872976=30, srv754300492=93, srv1778205700=41, srv254947613=60, srv1672077392=35, srv443357238=73, srv1205477045=12, srv678028251=89, srv1414481401=20, srv1583280730=29, srv323618402=66, srv1806718871=43, srv403995596=70, srv958805879=98, srv1601984375=31, srv147575142=25, srv127422241=14, srv282321757=64, srv2084221997=55, srv2096789282=57, srv1430923724=22, srv604867768=86, srv905220990=97, srv1168324892=9, srv1916772696=47, srv2097229431=58, srv168060734=37, srv1070221841=2, srv1158705569=7, srv116264608=8, srv1652319947=34, srv1507764700=26, srv1422670098=21, srv414570368=72, srv1545411568=27, srv2078686269=54, srv1779748749=42, srv337057280=67, srv1893956237=45, srv275551150=63, srv586186824=85, srv974116142=99, srv487873992=77, srv274549146=62, srv406721490=71, srv470704403=76, srv1708972144=39, srv1991449513=52, srv498721045=79, srv269559373=61, srv56938768=82, srv491649589=78, srv1152043363=6, srv1920825851=48, srv447707424=74, srv1404156294=19, srv578449451=83, srv1107176867=4, srv1102313235=3, srv1212999851=13, srv1368793256=16, srv1435139894=24, srv700227203=92, srv68969793=91, srv534033821=80, srv355143102=68, srv1896584379=46, srv1039113727=0, srv1815392482=44, srv1930219926=49, srv459541896=75, srv880006887=96, srv1987002520=51, srv616194164=87, srv1388813871=18, srv1976756209=50, srv556874958=81, srv2076664885=53, srv643824780=88, srv1631685919=33, srv1381892526=17, srv1110264479=5, srv311857740=65, srv1680387338=36, srv812924502=95, srv1056108273=1, srv1433631967=23, srv1551865387=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:03,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:03,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:03,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:03,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:03,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:03,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:03,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:03,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:03,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:03,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:03,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:03,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:03,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:03,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:03,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:03,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:03,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:03,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:03,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-29 06:56:03,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-29 06:56:03,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-29 06:56:03,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-29 06:56:03,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-29 06:56:03,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-29 06:56:03,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-29 06:56:03,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-29 06:56:03,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-29 06:56:03,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-29 06:56:03,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-29 06:56:03,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-29 06:56:03,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-29 06:56:03,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-29 06:56:03,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03940700235228906, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05367525079307235, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03940700235228906, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17116666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:03,415 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-29 06:56:03,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17628540296360495, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03940700235228906, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05367525079307235, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03940700235228906, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17116666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-29 06:56:03,825 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 567 ms to try 5000 different iterations.  Found a solution that moves 2670 regions; Going from a computed imbalance of 0.17628540296360495 to a new imbalance of 0.01466742145557106. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02361462639706167); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03233869579607758, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2966666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02361462639706167); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:03,844 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1652319947:69 , srv414570368:80 , srv1776803839:81 , srv806356522:81 , srv1551865387:82 , srv1591872976:82 , srv168060734:82 , srv2089168604:82 , srv275551150:82 , srv491649589:82 , srv556874958:82 , srv616194164:82 , srv1107176867:83 , srv1368793256:83 , srv1388813871:83 , srv1628809132:83 , srv1806718871:83 , srv1893956237:83 , srv2096789282:83 , srv254947613:83 , srv274549146:83 , srv578449451:83 , srv812924502:83 , srv974116142:83 , srv1070221841:84 , srv1193186845:84 , srv1414481401:84 , srv147575142:84 , srv1779748749:84 , srv1815392482:84 , srv1916772696:84 , srv1920825851:84 , srv2076664885:84 , srv470704403:84 , srv700227203:84 , srv1056108273:85 , srv1110264479:85 , srv116264608:85 , srv1171923453:85 , srv127422241:85 , srv1404156294:85 , srv1435139894:85 , srv1601984375:85 , srv1672077392:85 , srv1987002520:85 , srv387852791:85 , srv443357238:85 , srv56938768:85 , srv958805879:85 , srv1152043363:86 , srv1158705569:86 , srv1422670098:86 , srv1631685919:86 , srv1688479337:86 , srv1708972144:86 , srv1778205700:86 , srv1896584379:86 , srv1991449513:86 , srv337057280:86 , srv406721490:86 , srv487873992:86 , srv534033821:86 , srv580752545:86 , srv604867768:86 , srv880006887:86 , srv1342254449:87 , srv1381892526:87 , srv1433631967:87 , srv1976756209:87 , srv282321757:87 , srv311857740:87 , srv403995596:87 , srv459541896:87 , srv498721045:87 , srv678028251:87 , srv68969793:87 , srv905220990:87 , srv1168324892:88 , srv1212999851:88 , srv1430923724:88 , srv1545411568:88 , srv1680387338:88 , srv1930219926:88 , srv323618402:88 , srv688680994:88 , srv1039113727:89 , srv1102313235:89 , srv1583280730:89 , srv2078686269:89 , srv2123811428:89 , srv586186824:89 , srv643824780:89 , srv1205477045:90 , srv1507764700:90 , srv2084221997:90 , srv447707424:90 , srv754300492:90 , srv2097229431:91 , srv269559373:91 , srv355143102:544 }
2023-03-29 06:56:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688479337=38, srv1342254449=15, srv806356522=94, srv580752545=84, srv1193186845=11, srv1171923453=10, srv1628809132=32, srv2089168604=56, srv688680994=90, srv2123811428=59, srv1776803839=40, srv387852791=69, srv1591872976=30, srv754300492=93, srv1778205700=41, srv254947613=60, srv1672077392=35, srv443357238=73, srv1205477045=12, srv678028251=89, srv1414481401=20, srv1583280730=29, srv323618402=66, srv1806718871=43, srv403995596=70, srv958805879=98, srv1601984375=31, srv147575142=25, srv127422241=14, srv282321757=64, srv2084221997=55, srv2096789282=57, srv1430923724=22, srv604867768=86, srv905220990=97, srv1168324892=9, srv1916772696=47, srv2097229431=58, srv168060734=37, srv1070221841=2, srv1158705569=7, srv116264608=8, srv1652319947=34, srv1507764700=26, srv1422670098=21, srv414570368=72, srv1545411568=27, srv2078686269=54, srv1779748749=42, srv337057280=67, srv1893956237=45, srv275551150=63, srv586186824=85, srv974116142=99, srv487873992=77, srv274549146=62, srv406721490=71, srv470704403=76, srv1708972144=39, srv1991449513=52, srv498721045=79, srv269559373=61, srv56938768=82, srv491649589=78, srv1152043363=6, srv1920825851=48, srv447707424=74, srv1404156294=19, srv578449451=83, srv1107176867=4, srv1102313235=3, srv1212999851=13, srv1368793256=16, srv1435139894=24, srv700227203=92, srv68969793=91, srv534033821=80, srv355143102=68, srv1896584379=46, srv1039113727=0, srv1815392482=44, srv1930219926=49, srv459541896=75, srv880006887=96, srv1987002520=51, srv616194164=87, srv1388813871=18, srv1976756209=50, srv556874958=81, srv2076664885=53, srv643824780=88, srv1631685919=33, srv1381892526=17, srv1110264479=5, srv311857740=65, srv1680387338=36, srv812924502=95, srv1056108273=1, srv1433631967=23, srv1551865387=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:03,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:03,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:03,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:03,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:03,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:03,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-29 06:56:03,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-29 06:56:03,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-29 06:56:03,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-29 06:56:03,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-29 06:56:03,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-29 06:56:03,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-29 06:56:03,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-29 06:56:03,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-29 06:56:03,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-29 06:56:03,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-29 06:56:03,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-29 06:56:03,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-29 06:56:03,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-29 06:56:03,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-29 06:56:03,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-29 06:56:04,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02361462639706167); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03233869579607758, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02361462639706167); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:04,089 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-29 06:56:04,089 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014648725715979007, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02361462639706167); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03233869579607758, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02361462639706167); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-29 06:56:04,517 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 603 ms to try 5000 different iterations.  Found a solution that moves 930 regions; Going from a computed imbalance of 0.014648725715979007 to a new imbalance of 8.103240927810488E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.10333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:04,520 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv323618402:82 , srv1205477045:83 , srv1381892526:83 , srv1430923724:83 , srv1652319947:83 , srv1680387338:83 , srv2097229431:83 , srv643824780:83 , srv1039113727:84 , srv1152043363:84 , srv1158705569:84 , srv1435139894:84 , srv1507764700:84 , srv1583280730:84 , srv168060734:84 , srv1778205700:84 , srv1806718871:84 , srv2078686269:84 , srv2096789282:84 , srv269559373:84 , srv311857740:84 , srv406721490:84 , srv459541896:84 , srv534033821:84 , srv754300492:84 , srv1070221841:85 , srv116264608:85 , srv1193186845:85 , srv127422241:85 , srv1414481401:85 , srv147575142:85 , srv1688479337:85 , srv1779748749:85 , srv1896584379:85 , srv1976756209:85 , srv1991449513:85 , srv2084221997:85 , srv2123811428:85 , srv403995596:85 , srv447707424:85 , srv470704403:85 , srv586186824:85 , srv700227203:85 , srv806356522:85 , srv880006887:85 , srv958805879:85 , srv974116142:85 , srv1056108273:86 , srv1107176867:86 , srv1168324892:86 , srv1171923453:86 , srv1212999851:86 , srv1388813871:86 , srv1422670098:86 , srv1591872976:86 , srv1628809132:86 , srv1631685919:86 , srv1708972144:86 , srv1815392482:86 , srv1930219926:86 , srv1987002520:86 , srv2089168604:86 , srv274549146:86 , srv275551150:86 , srv282321757:86 , srv337057280:86 , srv443357238:86 , srv487873992:86 , srv491649589:86 , srv498721045:86 , srv580752545:86 , srv604867768:86 , srv616194164:86 , srv688680994:86 , srv905220990:86 , srv1102313235:87 , srv1110264479:87 , srv1342254449:87 , srv1404156294:87 , srv1433631967:87 , srv1545411568:87 , srv1551865387:87 , srv1601984375:87 , srv1893956237:87 , srv1916772696:87 , srv1920825851:87 , srv254947613:87 , srv387852791:87 , srv578449451:87 , srv678028251:87 , srv68969793:87 , srv812924502:87 , srv1368793256:88 , srv1672077392:88 , srv1776803839:88 , srv2076664885:88 , srv556874958:88 , srv56938768:88 , srv414570368:89 , srv355143102:535 }
2023-03-29 06:56:04,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:04,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688479337=38, srv1342254449=15, srv806356522=94, srv580752545=84, srv1193186845=11, srv1171923453=10, srv1628809132=32, srv2089168604=56, srv688680994=90, srv2123811428=59, srv1776803839=40, srv387852791=69, srv1591872976=30, srv754300492=93, srv1778205700=41, srv254947613=60, srv1672077392=35, srv443357238=73, srv1205477045=12, srv678028251=89, srv1414481401=20, srv1583280730=29, srv323618402=66, srv1806718871=43, srv403995596=70, srv958805879=98, srv1601984375=31, srv147575142=25, srv127422241=14, srv282321757=64, srv2084221997=55, srv2096789282=57, srv1430923724=22, srv604867768=86, srv905220990=97, srv1168324892=9, srv1916772696=47, srv2097229431=58, srv168060734=37, srv1070221841=2, srv1158705569=7, srv116264608=8, srv1652319947=34, srv1507764700=26, srv1422670098=21, srv414570368=72, srv1545411568=27, srv2078686269=54, srv1779748749=42, srv337057280=67, srv1893956237=45, srv275551150=63, srv586186824=85, srv974116142=99, srv487873992=77, srv274549146=62, srv406721490=71, srv470704403=76, srv1708972144=39, srv1991449513=52, srv498721045=79, srv269559373=61, srv56938768=82, srv491649589=78, srv1152043363=6, srv1920825851=48, srv447707424=74, srv1404156294=19, srv578449451=83, srv1107176867=4, srv1102313235=3, srv1212999851=13, srv1368793256=16, srv1435139894=24, srv700227203=92, srv68969793=91, srv534033821=80, srv355143102=68, srv1896584379=46, srv1039113727=0, srv1815392482=44, srv1930219926=49, srv459541896=75, srv880006887=96, srv1987002520=51, srv616194164=87, srv1388813871=18, srv1976756209=50, srv556874958=81, srv2076664885=53, srv643824780=88, srv1631685919=33, srv1381892526=17, srv1110264479=5, srv311857740=65, srv1680387338=36, srv812924502=95, srv1056108273=1, srv1433631967=23, srv1551865387=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:04,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:04,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:04,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:04,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-29 06:56:04,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-29 06:56:04,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-29 06:56:04,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-29 06:56:04,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-29 06:56:04,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-29 06:56:04,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-29 06:56:04,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-29 06:56:04,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-29 06:56:04,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-29 06:56:04,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-29 06:56:04,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-29 06:56:04,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-29 06:56:04,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:04,732 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-29 06:56:04,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.038120935972994E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-29 06:56:05,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 541 ms to try 5000 different iterations.  Found a solution that moves 306 regions; Going from a computed imbalance of 8.038120935972994E-4 to a new imbalance of 4.49025464308972E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.034, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:05,131 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1708972144:82 , srv1056108273:83 , srv1102313235:83 , srv1583280730:83 , srv1776803839:83 , srv905220990:83 , srv1039113727:84 , srv1110264479:84 , srv1212999851:84 , srv1342254449:84 , srv1368793256:84 , srv1388813871:84 , srv1404156294:84 , srv1545411568:84 , srv1551865387:84 , srv1601984375:84 , srv1631685919:84 , srv1672077392:84 , srv1680387338:84 , srv168060734:84 , srv1688479337:84 , srv1920825851:84 , srv1930219926:84 , srv1991449513:84 , srv2076664885:84 , srv2096789282:84 , srv2097229431:84 , srv254947613:84 , srv269559373:84 , srv274549146:84 , srv275551150:84 , srv282321757:84 , srv403995596:84 , srv498721045:84 , srv556874958:84 , srv578449451:84 , srv586186824:84 , srv678028251:84 , srv68969793:84 , srv1070221841:85 , srv1107176867:85 , srv1152043363:85 , srv1158705569:85 , srv1168324892:85 , srv1171923453:85 , srv1205477045:85 , srv127422241:85 , srv1381892526:85 , srv1414481401:85 , srv1422670098:85 , srv1433631967:85 , srv1435139894:85 , srv147575142:85 , srv1507764700:85 , srv1591872976:85 , srv1628809132:85 , srv1778205700:85 , srv1779748749:85 , srv1806718871:85 , srv1815392482:85 , srv1893956237:85 , srv1896584379:85 , srv1987002520:85 , srv2078686269:85 , srv2084221997:85 , srv2089168604:85 , srv2123811428:85 , srv323618402:85 , srv337057280:85 , srv387852791:85 , srv406721490:85 , srv414570368:85 , srv447707424:85 , srv459541896:85 , srv470704403:85 , srv487873992:85 , srv491649589:85 , srv534033821:85 , srv56938768:85 , srv580752545:85 , srv604867768:85 , srv616194164:85 , srv643824780:85 , srv688680994:85 , srv700227203:85 , srv754300492:85 , srv806356522:85 , srv812924502:85 , srv880006887:85 , srv958805879:85 , srv974116142:85 , srv116264608:86 , srv1193186845:86 , srv1430923724:86 , srv1652319947:86 , srv1916772696:86 , srv1976756209:86 , srv311857740:86 , srv443357238:86 , srv355143102:623 }
2023-03-29 06:56:05,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:05,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688479337=38, srv1342254449=15, srv806356522=94, srv580752545=84, srv1193186845=11, srv1171923453=10, srv1628809132=32, srv2089168604=56, srv688680994=90, srv2123811428=59, srv1776803839=40, srv387852791=69, srv1591872976=30, srv754300492=93, srv1778205700=41, srv254947613=60, srv1672077392=35, srv443357238=73, srv1205477045=12, srv678028251=89, srv1414481401=20, srv1583280730=29, srv323618402=66, srv1806718871=43, srv403995596=70, srv958805879=98, srv1601984375=31, srv147575142=25, srv127422241=14, srv282321757=64, srv2084221997=55, srv2096789282=57, srv1430923724=22, srv604867768=86, srv905220990=97, srv1168324892=9, srv1916772696=47, srv2097229431=58, srv168060734=37, srv1070221841=2, srv1158705569=7, srv116264608=8, srv1652319947=34, srv1507764700=26, srv1422670098=21, srv414570368=72, srv1545411568=27, srv2078686269=54, srv1779748749=42, srv337057280=67, srv1893956237=45, srv275551150=63, srv586186824=85, srv974116142=99, srv487873992=77, srv274549146=62, srv406721490=71, srv470704403=76, srv1708972144=39, srv1991449513=52, srv498721045=79, srv269559373=61, srv56938768=82, srv491649589=78, srv1152043363=6, srv1920825851=48, srv447707424=74, srv1404156294=19, srv578449451=83, srv1107176867=4, srv1102313235=3, srv1212999851=13, srv1368793256=16, srv1435139894=24, srv700227203=92, srv68969793=91, srv534033821=80, srv355143102=68, srv1896584379=46, srv1039113727=0, srv1815392482=44, srv1930219926=49, srv459541896=75, srv880006887=96, srv1987002520=51, srv616194164=87, srv1388813871=18, srv1976756209=50, srv556874958=81, srv2076664885=53, srv643824780=88, srv1631685919=33, srv1381892526=17, srv1110264479=5, srv311857740=65, srv1680387338=36, srv812924502=95, srv1056108273=1, srv1433631967=23, srv1551865387=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:05,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:05,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:05,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:05,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:05,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:05,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:05,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-29 06:56:05,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-29 06:56:05,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-29 06:56:05,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-29 06:56:05,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-29 06:56:05,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-29 06:56:05,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-29 06:56:05,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-29 06:56:05,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-29 06:56:05,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-29 06:56:05,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-29 06:56:05,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-29 06:56:05,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-29 06:56:05,318 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:05,318 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-29 06:56:05,318 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.275988863495385E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-29 06:56:05,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 428 ms to try 5000 different iterations.  Found a solution that moves 45 regions; Going from a computed imbalance of 4.275988863495385E-5 to a new imbalance of 7.388336031027E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.005); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:05,619 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1193186845:83 , srv1430923724:83 , srv1591872976:83 , srv1601984375:83 , srv1652319947:83 , srv1806718871:83 , srv1896584379:83 , srv1916772696:83 , srv387852791:83 , srv414570368:83 , srv56938768:83 , srv1070221841:84 , srv1102313235:84 , srv1107176867:84 , srv1110264479:84 , srv1152043363:84 , srv1158705569:84 , srv116264608:84 , srv1168324892:84 , srv1171923453:84 , srv1205477045:84 , srv1212999851:84 , srv127422241:84 , srv1342254449:84 , srv1381892526:84 , srv1388813871:84 , srv1404156294:84 , srv1414481401:84 , srv1422670098:84 , srv1433631967:84 , srv1435139894:84 , srv147575142:84 , srv1507764700:84 , srv1545411568:84 , srv1551865387:84 , srv1583280730:84 , srv1628809132:84 , srv1631685919:84 , srv1672077392:84 , srv1688479337:84 , srv1778205700:84 , srv1779748749:84 , srv1815392482:84 , srv1893956237:84 , srv1930219926:84 , srv1976756209:84 , srv1987002520:84 , srv2076664885:84 , srv2078686269:84 , srv2084221997:84 , srv2089168604:84 , srv2096789282:84 , srv2097229431:84 , srv2123811428:84 , srv269559373:84 , srv274549146:84 , srv275551150:84 , srv311857740:84 , srv323618402:84 , srv337057280:84 , srv403995596:84 , srv406721490:84 , srv443357238:84 , srv447707424:84 , srv459541896:84 , srv470704403:84 , srv487873992:84 , srv491649589:84 , srv498721045:84 , srv534033821:84 , srv556874958:84 , srv578449451:84 , srv580752545:84 , srv586186824:84 , srv604867768:84 , srv616194164:84 , srv643824780:84 , srv678028251:84 , srv688680994:84 , srv68969793:84 , srv700227203:84 , srv754300492:84 , srv806356522:84 , srv812924502:84 , srv880006887:84 , srv905220990:84 , srv958805879:84 , srv974116142:84 , srv1039113727:85 , srv1056108273:85 , srv1368793256:85 , srv1680387338:85 , srv168060734:85 , srv1708972144:85 , srv1776803839:85 , srv1920825851:85 , srv1991449513:85 , srv254947613:85 , srv282321757:85 , srv355143102:684 }
2023-03-29 06:56:05,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:05,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688479337=38, srv1342254449=15, srv806356522=94, srv580752545=84, srv1193186845=11, srv1171923453=10, srv1628809132=32, srv2089168604=56, srv688680994=90, srv2123811428=59, srv1776803839=40, srv387852791=69, srv1591872976=30, srv754300492=93, srv1778205700=41, srv254947613=60, srv1672077392=35, srv443357238=73, srv1205477045=12, srv678028251=89, srv1414481401=20, srv1583280730=29, srv323618402=66, srv1806718871=43, srv403995596=70, srv958805879=98, srv1601984375=31, srv147575142=25, srv127422241=14, srv282321757=64, srv2084221997=55, srv2096789282=57, srv1430923724=22, srv604867768=86, srv905220990=97, srv1168324892=9, srv1916772696=47, srv2097229431=58, srv168060734=37, srv1070221841=2, srv1158705569=7, srv116264608=8, srv1652319947=34, srv1507764700=26, srv1422670098=21, srv414570368=72, srv1545411568=27, srv2078686269=54, srv1779748749=42, srv337057280=67, srv1893956237=45, srv275551150=63, srv586186824=85, srv974116142=99, srv487873992=77, srv274549146=62, srv406721490=71, srv470704403=76, srv1708972144=39, srv1991449513=52, srv498721045=79, srv269559373=61, srv56938768=82, srv491649589=78, srv1152043363=6, srv1920825851=48, srv447707424=74, srv1404156294=19, srv578449451=83, srv1107176867=4, srv1102313235=3, srv1212999851=13, srv1368793256=16, srv1435139894=24, srv700227203=92, srv68969793=91, srv534033821=80, srv355143102=68, srv1896584379=46, srv1039113727=0, srv1815392482=44, srv1930219926=49, srv459541896=75, srv880006887=96, srv1987002520=51, srv616194164=87, srv1388813871=18, srv1976756209=50, srv556874958=81, srv2076664885=53, srv643824780=88, srv1631685919=33, srv1381892526=17, srv1110264479=5, srv311857740=65, srv1680387338=36, srv812924502=95, srv1056108273=1, srv1433631967=23, srv1551865387=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:05,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:05,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:05,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:05,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:05,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-29 06:56:05,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-29 06:56:05,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-29 06:56:05,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-29 06:56:05,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-29 06:56:05,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-29 06:56:05,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-29 06:56:05,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-29 06:56:05,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-29 06:56:05,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:05,773 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1193186845:83 , srv1430923724:83 , srv1591872976:83 , srv1601984375:83 , srv1652319947:83 , srv1806718871:83 , srv1896584379:83 , srv1916772696:83 , srv387852791:83 , srv414570368:83 , srv56938768:83 , srv1070221841:84 , srv1102313235:84 , srv1107176867:84 , srv1110264479:84 , srv1152043363:84 , srv1158705569:84 , srv116264608:84 , srv1168324892:84 , srv1171923453:84 , srv1205477045:84 , srv1212999851:84 , srv127422241:84 , srv1342254449:84 , srv1381892526:84 , srv1388813871:84 , srv1404156294:84 , srv1414481401:84 , srv1422670098:84 , srv1433631967:84 , srv1435139894:84 , srv147575142:84 , srv1507764700:84 , srv1545411568:84 , srv1551865387:84 , srv1583280730:84 , srv1628809132:84 , srv1631685919:84 , srv1672077392:84 , srv1688479337:84 , srv1778205700:84 , srv1779748749:84 , srv1815392482:84 , srv1893956237:84 , srv1930219926:84 , srv1976756209:84 , srv1987002520:84 , srv2076664885:84 , srv2078686269:84 , srv2084221997:84 , srv2089168604:84 , srv2096789282:84 , srv2097229431:84 , srv2123811428:84 , srv269559373:84 , srv274549146:84 , srv275551150:84 , srv311857740:84 , srv323618402:84 , srv337057280:84 , srv403995596:84 , srv406721490:84 , srv443357238:84 , srv447707424:84 , srv459541896:84 , srv470704403:84 , srv487873992:84 , srv491649589:84 , srv498721045:84 , srv534033821:84 , srv556874958:84 , srv578449451:84 , srv580752545:84 , srv586186824:84 , srv604867768:84 , srv616194164:84 , srv643824780:84 , srv678028251:84 , srv688680994:84 , srv68969793:84 , srv700227203:84 , srv754300492:84 , srv806356522:84 , srv812924502:84 , srv880006887:84 , srv905220990:84 , srv958805879:84 , srv974116142:84 , srv1039113727:85 , srv1056108273:85 , srv1368793256:85 , srv1680387338:85 , srv168060734:85 , srv1708972144:85 , srv1776803839:85 , srv1920825851:85 , srv1991449513:85 , srv254947613:85 , srv282321757:85 , srv355143102:684 }
2023-03-29 06:56:05,805 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=404 (was 404), ProcessCount=172 (was 172), AvailableMemoryMB=7489 (was 7970)
2023-03-29 06:56:05,825 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=404, ProcessCount=172, AvailableMemoryMB=7489
2023-03-29 06:56:05,826 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-29 06:56:05,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-29 06:56:05,839 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1145683260:84 , srv1205903015:84 , srv1259883717:84 , srv1282380102:84 , srv1391989831:84 , srv140769476:84 , srv1422899446:84 , srv1426021510:84 , srv1429257887:84 , srv1444447160:84 , srv1461515679:84 , srv1584641329:84 , srv1600939106:84 , srv1681476689:84 , srv1699572835:84 , srv2060988018:84 , srv287640672:84 , srv35962067:84 , srv371447202:84 , srv426018623:84 , srv432353915:84 , srv458338932:84 , srv54143455:84 , srv611894619:84 , srv683592043:84 , srv78797522:84 , srv874119973:84 , srv910605113:84 , srv989426174:84 , srv1417978793:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-29 06:56:05,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:56:05,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1282380102=3, srv140769476=5, srv1426021510=8, srv2060988018=16, srv683592043=25, srv1205903015=1, srv1584641329=12, srv426018623=20, srv78797522=26, srv54143455=23, srv611894619=24, srv1461515679=11, srv458338932=22, srv1699572835=15, srv1681476689=14, srv371447202=19, srv287640672=17, srv910605113=28, srv874119973=27, srv35962067=18, srv1444447160=10, srv1600939106=13, srv1429257887=9, srv1259883717=2, srv432353915=21, srv1422899446=7, srv989426174=29, srv1391989831=4, srv1145683260=0, srv1417978793=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:56:05,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:56:05,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:56:05,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:56:05,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:56:05,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:56:05,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:56:05,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-29 06:56:05,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2083250269351113, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:56:05,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912849468621712, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2083250269351113, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-29 06:58:05,861 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5930866 different iterations.  Found a solution that moves 1871 regions; Going from a computed imbalance of 0.9912849468621712 to a new imbalance of 4.367007337919408E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.692962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:58:05,868 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1145683260:90 , srv1205903015:90 , srv1259883717:90 , srv1282380102:90 , srv1391989831:90 , srv140769476:90 , srv1417978793:90 , srv1422899446:90 , srv1426021510:90 , srv1429257887:90 , srv1444447160:90 , srv1461515679:90 , srv1584641329:90 , srv1600939106:90 , srv1681476689:90 , srv1699572835:90 , srv2060988018:90 , srv287640672:90 , srv35962067:90 , srv371447202:90 , srv426018623:90 , srv432353915:90 , srv458338932:90 , srv54143455:90 , srv611894619:90 , srv683592043:90 , srv78797522:90 , srv874119973:90 , srv910605113:90 , srv989426174:90 }
2023-03-29 06:58:05,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-29 06:58:05,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1282380102=3, srv140769476=5, srv1426021510=8, srv2060988018=16, srv683592043=25, srv1205903015=1, srv1584641329=12, srv426018623=20, srv78797522=26, srv54143455=23, srv611894619=24, srv1461515679=11, srv458338932=22, srv1699572835=15, srv1681476689=14, srv371447202=19, srv287640672=17, srv910605113=28, srv874119973=27, srv35962067=18, srv1444447160=10, srv1600939106=13, srv1429257887=9, srv1259883717=2, srv432353915=21, srv1422899446=7, srv989426174=29, srv1391989831=4, srv1145683260=0, srv1417978793=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-29 06:58:05,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-29 06:58:05,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-29 06:58:05,888 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-29 06:58:05,888 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1145683260:90 , srv1205903015:90 , srv1259883717:90 , srv1282380102:90 , srv1391989831:90 , srv140769476:90 , srv1417978793:90 , srv1422899446:90 , srv1426021510:90 , srv1429257887:90 , srv1444447160:90 , srv1461515679:90 , srv1584641329:90 , srv1600939106:90 , srv1681476689:90 , srv1699572835:90 , srv2060988018:90 , srv287640672:90 , srv35962067:90 , srv371447202:90 , srv426018623:90 , srv432353915:90 , srv458338932:90 , srv54143455:90 , srv611894619:90 , srv683592043:90 , srv78797522:90 , srv874119973:90 , srv910605113:90 , srv989426174:90 }
2023-03-29 06:58:05,900 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 404), ProcessCount=170 (was 172), AvailableMemoryMB=7448 (was 7489)