2023-11-01 01:56:51,736 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-01 01:56:51,990 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-01 01:56:52,080 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-01 01:56:52,133 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-01 01:56:52,139 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-01 01:56:52,149 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=169, AvailableMemoryMB=7130
2023-11-01 01:56:52,151 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-01 01:56:52,151 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-01 01:56:52,260 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1040865205:84 , srv1041387117:84 , srv1042944084:84 , srv1084572011:84 , srv1108367405:84 , srv1130865929:84 , srv1142485276:84 , srv1159999230:84 , srv117379840:84 , srv1186621071:84 , srv1190289862:84 , srv1196494380:84 , srv1214679142:84 , srv1259633990:84 , srv1313576884:84 , srv1321616950:84 , srv1340748708:84 , srv1347811750:84 , srv1354474606:84 , srv1393109384:84 , srv1394171:84 , srv142164663:84 , srv1426312966:84 , srv1475969830:84 , srv1478441607:84 , srv1504353654:84 , srv1540869147:84 , srv1569013787:84 , srv1579622155:84 , srv1671254300:84 , srv1671701286:84 , srv1686098228:84 , srv1702761072:84 , srv1705450293:84 , srv1711320852:84 , srv1714873610:84 , srv1715147966:84 , srv1754362226:84 , srv1765925486:84 , srv1767303418:84 , srv178997599:84 , srv1799202164:84 , srv1807480027:84 , srv1819747761:84 , srv1823274127:84 , srv1850353724:84 , srv186493363:84 , srv1888462370:84 , srv1930844801:84 , srv1931650294:84 , srv1954203073:84 , srv195452997:84 , srv1976553917:84 , srv1996760187:84 , srv2024494612:84 , srv2024956774:84 , srv2037846846:84 , srv22881692:84 , srv232766465:84 , srv235199148:84 , srv236336291:84 , srv253345300:84 , srv306663465:84 , srv317861438:84 , srv325225417:84 , srv385323676:84 , srv397159771:84 , srv451416684:84 , srv462274777:84 , srv463142964:84 , srv47296453:84 , srv478380897:84 , srv479970032:84 , srv481578729:84 , srv495905944:84 , srv538885127:84 , srv5513396:84 , srv560878998:84 , srv561433850:84 , srv582132662:84 , srv597409251:84 , srv632333995:84 , srv646099505:84 , srv654557757:84 , srv693096040:84 , srv700109746:84 , srv705724568:84 , srv744101719:84 , srv746372110:84 , srv799406136:84 , srv804879228:84 , srv832880738:84 , srv876485369:84 , srv881308802:84 , srv883595732:84 , srv928960903:84 , srv943659211:84 , srv95090165:84 , srv980770242:84 , srv411159448:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-01 01:56:52,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:52,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv744101719=88, srv538885127=76, srv1084572011=3, srv799406136=90, srv1671701286=30, srv705724568=87, srv232766465=58, srv397159771=66, srv178997599=40, srv462274777=69, srv632333995=82, srv1807480027=42, srv597409251=81, srv943659211=97, srv2024494612=54, srv478380897=72, srv1321616950=15, srv1478441607=24, srv2024956774=55, srv1711320852=34, srv700109746=86, srv1041387117=1, srv1714873610=35, srv481578729=74, srv928960903=96, srv1765925486=38, srv1715147966=36, srv1142485276=6, srv1313576884=14, srv883595732=95, srv1196494380=11, srv1930844801=48, srv1702761072=32, srv236336291=60, srv1042944084=2, srv1540869147=26, srv385323676=65, srv463142964=70, srv1393109384=19, srv1767303418=39, srv1799202164=41, srv306663465=62, srv47296453=71, srv654557757=84, srv253345300=61, srv1888462370=47, srv411159448=67, srv876485369=93, srv1394171=20, srv746372110=89, srv561433850=79, srv142164663=21, srv1259633990=13, srv5513396=77, srv1996760187=53, srv1186621071=9, srv1354474606=18, srv1823274127=44, srv325225417=64, srv479970032=73, srv22881692=57, srv1671254300=29, srv1504353654=25, srv1579622155=28, srv646099505=83, srv881308802=94, srv1475969830=23, srv117379840=8, srv560878998=78, srv1340748708=16, srv1976553917=52, srv1159999230=7, srv1754362226=37, srv495905944=75, srv1347811750=17, srv1569013787=27, srv1190289862=10, srv1931650294=49, srv317861438=63, srv980770242=99, srv186493363=46, srv1108367405=4, srv582132662=80, srv1214679142=12, srv804879228=91, srv1819747761=43, srv832880738=92, srv1954203073=50, srv693096040=85, srv1130865929=5, srv451416684=68, srv1426312966=22, srv95090165=98, srv1686098228=31, srv1705450293=33, srv1040865205=0, srv1850353724=45, srv2037846846=56, srv195452997=51, srv235199148=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:52,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:52,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:52,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:52,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:52,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:52,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-01 01:56:52,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-01 01:56:52,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-01 01:56:52,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-01 01:56:52,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-01 01:56:52,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-01 01:56:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-01 01:56:52,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-01 01:56:52,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-01 01:56:52,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-01 01:56:52,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-01 01:56:52,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-01 01:56:52,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-01 01:56:52,617 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:52,618 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-01 01:56:52,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-01 01:56:52,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 518 ms to try 5000 different iterations.  Found a solution that moves 4692 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1825842057876297. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03936552545170759, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0573918736450887, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5213333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03936552545170759, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17758333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:52,892 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv142164663:83 , srv1714873610:83 , srv1715147966:83 , srv1850353724:83 , srv397159771:83 , srv481578729:83 , srv582132662:83 , srv1130865929:84 , srv1214679142:84 , srv1259633990:84 , srv1340748708:84 , srv1354474606:84 , srv1393109384:84 , srv1504353654:84 , srv1799202164:84 , srv1888462370:84 , srv451416684:84 , srv478380897:84 , srv479970032:84 , srv538885127:84 , srv597409251:84 , srv746372110:84 , srv799406136:84 , srv881308802:84 , srv1084572011:85 , srv1142485276:85 , srv1196494380:85 , srv1394171:85 , srv1579622155:85 , srv186493363:85 , srv1954203073:85 , srv1976553917:85 , srv560878998:85 , srv561433850:85 , srv654557757:85 , srv117379840:86 , srv1186621071:86 , srv1313576884:86 , srv1478441607:86 , srv1671701286:86 , srv1754362226:86 , srv178997599:86 , srv1807480027:86 , srv1823274127:86 , srv1930844801:86 , srv195452997:86 , srv2037846846:86 , srv235199148:86 , srv317861438:86 , srv325225417:86 , srv5513396:86 , srv705724568:86 , srv876485369:86 , srv928960903:86 , srv943659211:86 , srv980770242:86 , srv1040865205:87 , srv1042944084:87 , srv1190289862:87 , srv1569013787:87 , srv1671254300:87 , srv2024494612:87 , srv236336291:87 , srv462274777:87 , srv463142964:87 , srv632333995:87 , srv693096040:87 , srv700109746:87 , srv1108367405:88 , srv1426312966:88 , srv1475969830:88 , srv1540869147:88 , srv1686098228:88 , srv1711320852:88 , srv2024956774:88 , srv22881692:88 , srv253345300:88 , srv306663465:88 , srv385323676:88 , srv646099505:88 , srv804879228:88 , srv1321616950:89 , srv1347811750:89 , srv1702761072:89 , srv1765925486:89 , srv1819747761:89 , srv744101719:89 , srv883595732:89 , srv95090165:89 , srv1159999230:90 , srv1931650294:90 , srv1996760187:90 , srv47296453:90 , srv495905944:90 , srv1041387117:91 , srv1705450293:91 , srv232766465:91 , srv832880738:92 , srv1767303418:95 , srv411159448:440 }
2023-11-01 01:56:52,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:52,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv744101719=88, srv538885127=76, srv1084572011=3, srv799406136=90, srv1671701286=30, srv705724568=87, srv232766465=58, srv397159771=66, srv178997599=40, srv462274777=69, srv632333995=82, srv1807480027=42, srv597409251=81, srv943659211=97, srv2024494612=54, srv478380897=72, srv1321616950=15, srv1478441607=24, srv2024956774=55, srv1711320852=34, srv700109746=86, srv1041387117=1, srv1714873610=35, srv481578729=74, srv928960903=96, srv1765925486=38, srv1715147966=36, srv1142485276=6, srv1313576884=14, srv883595732=95, srv1196494380=11, srv1930844801=48, srv1702761072=32, srv236336291=60, srv1042944084=2, srv1540869147=26, srv385323676=65, srv463142964=70, srv1393109384=19, srv1767303418=39, srv1799202164=41, srv306663465=62, srv47296453=71, srv654557757=84, srv253345300=61, srv1888462370=47, srv411159448=67, srv876485369=93, srv1394171=20, srv746372110=89, srv561433850=79, srv142164663=21, srv1259633990=13, srv5513396=77, srv1996760187=53, srv1186621071=9, srv1354474606=18, srv1823274127=44, srv325225417=64, srv479970032=73, srv22881692=57, srv1671254300=29, srv1504353654=25, srv1579622155=28, srv646099505=83, srv881308802=94, srv1475969830=23, srv117379840=8, srv560878998=78, srv1340748708=16, srv1976553917=52, srv1159999230=7, srv1754362226=37, srv495905944=75, srv1347811750=17, srv1569013787=27, srv1190289862=10, srv1931650294=49, srv317861438=63, srv980770242=99, srv186493363=46, srv1108367405=4, srv582132662=80, srv1214679142=12, srv804879228=91, srv1819747761=43, srv832880738=92, srv1954203073=50, srv693096040=85, srv1130865929=5, srv451416684=68, srv1426312966=22, srv95090165=98, srv1686098228=31, srv1705450293=33, srv1040865205=0, srv1850353724=45, srv2037846846=56, srv195452997=51, srv235199148=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:52,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:52,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-01 01:56:52,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-01 01:56:52,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-01 01:56:52,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-01 01:56:52,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-01 01:56:52,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-01 01:56:52,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-01 01:56:53,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03936552545170759, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0573918736450887, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03936552545170759, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17758333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,008 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-01 01:56:53,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18255135170142522, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03936552545170759, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0573918736450887, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03936552545170759, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17758333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-01 01:56:53,171 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 238 ms to try 5000 different iterations.  Found a solution that moves 2588 regions; Going from a computed imbalance of 0.18255135170142522 to a new imbalance of 0.017222606578745872. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02377934060337068); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034934603004659344, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28755555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02377934060337068); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,178 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1767303418:78 , srv832880738:79 , srv1347811750:80 , srv1931650294:80 , srv47296453:81 , srv632333995:81 , srv1040865205:82 , srv1041387117:82 , srv1108367405:82 , srv1321616950:82 , srv1702761072:82 , srv1705450293:82 , srv1765925486:82 , srv1807480027:82 , srv1819747761:82 , srv1996760187:82 , srv495905944:82 , srv1159999230:83 , srv1686098228:83 , srv2024494612:83 , srv2024956774:83 , srv236336291:83 , srv253345300:83 , srv463142964:83 , srv744101719:83 , srv95090165:83 , srv1042944084:84 , srv1142485276:84 , srv1426312966:84 , srv1540869147:84 , srv1569013787:84 , srv1754362226:84 , srv22881692:84 , srv700109746:84 , srv980770242:84 , srv117379840:85 , srv1186621071:85 , srv1394171:85 , srv1475969830:85 , srv1671254300:85 , srv1711320852:85 , srv1823274127:85 , srv195452997:85 , srv306663465:85 , srv317861438:85 , srv385323676:85 , srv451416684:85 , srv538885127:85 , srv5513396:85 , srv560878998:85 , srv693096040:85 , srv705724568:85 , srv804879228:85 , srv883595732:85 , srv1478441607:86 , srv1504353654:86 , srv1579622155:86 , srv1671701286:86 , srv1714873610:86 , srv1888462370:86 , srv1930844801:86 , srv232766465:86 , srv235199148:86 , srv646099505:86 , srv876485369:86 , srv928960903:86 , srv1084572011:87 , srv1190289862:87 , srv1196494380:87 , srv1313576884:87 , srv1393109384:87 , srv178997599:87 , srv1976553917:87 , srv654557757:87 , srv1130865929:88 , srv1214679142:88 , srv1259633990:88 , srv1354474606:88 , srv1715147966:88 , srv1799202164:88 , srv325225417:88 , srv397159771:88 , srv481578729:88 , srv597409251:88 , srv746372110:88 , srv799406136:88 , srv943659211:88 , srv1340748708:89 , srv1954203073:89 , srv2037846846:89 , srv561433850:89 , srv582132662:89 , srv881308802:89 , srv478380897:90 , srv479970032:90 , srv142164663:91 , srv1850353724:92 , srv186493363:92 , srv462274777:95 , srv411159448:545 }
2023-11-01 01:56:53,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:53,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv744101719=88, srv538885127=76, srv1084572011=3, srv799406136=90, srv1671701286=30, srv705724568=87, srv232766465=58, srv397159771=66, srv178997599=40, srv462274777=69, srv632333995=82, srv1807480027=42, srv597409251=81, srv943659211=97, srv2024494612=54, srv478380897=72, srv1321616950=15, srv1478441607=24, srv2024956774=55, srv1711320852=34, srv700109746=86, srv1041387117=1, srv1714873610=35, srv481578729=74, srv928960903=96, srv1765925486=38, srv1715147966=36, srv1142485276=6, srv1313576884=14, srv883595732=95, srv1196494380=11, srv1930844801=48, srv1702761072=32, srv236336291=60, srv1042944084=2, srv1540869147=26, srv385323676=65, srv463142964=70, srv1393109384=19, srv1767303418=39, srv1799202164=41, srv306663465=62, srv47296453=71, srv654557757=84, srv253345300=61, srv1888462370=47, srv411159448=67, srv876485369=93, srv1394171=20, srv746372110=89, srv561433850=79, srv142164663=21, srv1259633990=13, srv5513396=77, srv1996760187=53, srv1186621071=9, srv1354474606=18, srv1823274127=44, srv325225417=64, srv479970032=73, srv22881692=57, srv1671254300=29, srv1504353654=25, srv1579622155=28, srv646099505=83, srv881308802=94, srv1475969830=23, srv117379840=8, srv560878998=78, srv1340748708=16, srv1976553917=52, srv1159999230=7, srv1754362226=37, srv495905944=75, srv1347811750=17, srv1569013787=27, srv1190289862=10, srv1931650294=49, srv317861438=63, srv980770242=99, srv186493363=46, srv1108367405=4, srv582132662=80, srv1214679142=12, srv804879228=91, srv1819747761=43, srv832880738=92, srv1954203073=50, srv693096040=85, srv1130865929=5, srv451416684=68, srv1426312966=22, srv95090165=98, srv1686098228=31, srv1705450293=33, srv1040865205=0, srv1850353724=45, srv2037846846=56, srv195452997=51, srv235199148=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:53,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:53,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:53,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-01 01:56:53,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-01 01:56:53,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-01 01:56:53,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-01 01:56:53,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-01 01:56:53,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-01 01:56:53,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-01 01:56:53,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-01 01:56:53,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-01 01:56:53,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-01 01:56:53,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-01 01:56:53,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-01 01:56:53,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02377934060337068); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034934603004659344, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02377934060337068); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,296 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-01 01:56:53,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.017204485015425933, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02377934060337068); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034934603004659344, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02377934060337068); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-01 01:56:53,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 231 ms to try 5000 different iterations.  Found a solution that moves 1010 regions; Going from a computed imbalance of 0.017204485015425933 to a new imbalance of 8.722037894955803E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006442160669684254); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008632670957261212); MoveCostFunction : (multiplier=7.0, imbalance=0.11222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006442160669684254); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0055); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,447 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv462274777:76 , srv232766465:81 , srv186493363:82 , srv2037846846:82 , srv1190289862:83 , srv1340748708:83 , srv1850353724:83 , srv1954203073:83 , srv479970032:83 , srv561433850:83 , srv646099505:83 , srv883595732:83 , srv1041387117:84 , srv1159999230:84 , srv1313576884:84 , srv1475969830:84 , srv1671254300:84 , srv1711320852:84 , srv1767303418:84 , srv325225417:84 , srv478380897:84 , srv654557757:84 , srv804879228:84 , srv881308802:84 , srv943659211:84 , srv1084572011:85 , srv1196494380:85 , srv1214679142:85 , srv1259633990:85 , srv1354474606:85 , srv142164663:85 , srv1426312966:85 , srv1478441607:85 , srv1540869147:85 , srv1705450293:85 , srv1930844801:85 , srv1976553917:85 , srv1996760187:85 , srv235199148:85 , srv306663465:85 , srv385323676:85 , srv495905944:85 , srv582132662:85 , srv597409251:85 , srv693096040:85 , srv746372110:85 , srv1186621071:86 , srv1393109384:86 , srv1569013787:86 , srv1671701286:86 , srv1715147966:86 , srv178997599:86 , srv1799202164:86 , srv1819747761:86 , srv1888462370:86 , srv195452997:86 , srv22881692:86 , srv317861438:86 , srv47296453:86 , srv481578729:86 , srv5513396:86 , srv700109746:86 , srv744101719:86 , srv799406136:86 , srv832880738:86 , srv876485369:86 , srv928960903:86 , srv95090165:86 , srv1108367405:87 , srv1130865929:87 , srv117379840:87 , srv1321616950:87 , srv1579622155:87 , srv1686098228:87 , srv1702761072:87 , srv1754362226:87 , srv1765925486:87 , srv1823274127:87 , srv2024956774:87 , srv236336291:87 , srv253345300:87 , srv397159771:87 , srv463142964:87 , srv705724568:87 , srv980770242:87 , srv1040865205:88 , srv1347811750:88 , srv1394171:88 , srv1504353654:88 , srv1714873610:88 , srv1931650294:88 , srv2024494612:88 , srv451416684:88 , srv560878998:88 , srv1042944084:89 , srv1142485276:89 , srv1807480027:89 , srv538885127:89 , srv632333995:89 , srv411159448:530 }
2023-11-01 01:56:53,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:53,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv744101719=88, srv538885127=76, srv1084572011=3, srv799406136=90, srv1671701286=30, srv705724568=87, srv232766465=58, srv397159771=66, srv178997599=40, srv462274777=69, srv632333995=82, srv1807480027=42, srv597409251=81, srv943659211=97, srv2024494612=54, srv478380897=72, srv1321616950=15, srv1478441607=24, srv2024956774=55, srv1711320852=34, srv700109746=86, srv1041387117=1, srv1714873610=35, srv481578729=74, srv928960903=96, srv1765925486=38, srv1715147966=36, srv1142485276=6, srv1313576884=14, srv883595732=95, srv1196494380=11, srv1930844801=48, srv1702761072=32, srv236336291=60, srv1042944084=2, srv1540869147=26, srv385323676=65, srv463142964=70, srv1393109384=19, srv1767303418=39, srv1799202164=41, srv306663465=62, srv47296453=71, srv654557757=84, srv253345300=61, srv1888462370=47, srv411159448=67, srv876485369=93, srv1394171=20, srv746372110=89, srv561433850=79, srv142164663=21, srv1259633990=13, srv5513396=77, srv1996760187=53, srv1186621071=9, srv1354474606=18, srv1823274127=44, srv325225417=64, srv479970032=73, srv22881692=57, srv1671254300=29, srv1504353654=25, srv1579622155=28, srv646099505=83, srv881308802=94, srv1475969830=23, srv117379840=8, srv560878998=78, srv1340748708=16, srv1976553917=52, srv1159999230=7, srv1754362226=37, srv495905944=75, srv1347811750=17, srv1569013787=27, srv1190289862=10, srv1931650294=49, srv317861438=63, srv980770242=99, srv186493363=46, srv1108367405=4, srv582132662=80, srv1214679142=12, srv804879228=91, srv1819747761=43, srv832880738=92, srv1954203073=50, srv693096040=85, srv1130865929=5, srv451416684=68, srv1426312966=22, srv95090165=98, srv1686098228=31, srv1705450293=33, srv1040865205=0, srv1850353724=45, srv2037846846=56, srv195452997=51, srv235199148=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:53,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:53,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-01 01:56:53,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-01 01:56:53,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-01 01:56:53,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-01 01:56:53,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-01 01:56:53,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-01 01:56:53,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-01 01:56:53,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-01 01:56:53,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-01 01:56:53,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-01 01:56:53,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-01 01:56:53,547 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006442160669684254); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008632670957261212); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006442160669684254); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0055); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,548 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-01 01:56:53,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.651316183390352E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006442160669684254); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008632670957261212); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006442160669684254); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0055); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-01 01:56:53,761 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 284 ms to try 5000 different iterations.  Found a solution that moves 304 regions; Going from a computed imbalance of 8.651316183390352E-4 to a new imbalance of 6.496916458834443E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.033777777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,762 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1042944084:82 , srv1130865929:83 , srv1142485276:83 , srv1321616950:83 , srv142164663:83 , srv178997599:83 , srv928960903:83 , srv117379840:84 , srv1313576884:84 , srv1394171:84 , srv1475969830:84 , srv1504353654:84 , srv1569013787:84 , srv1671701286:84 , srv1686098228:84 , srv1702761072:84 , srv1714873610:84 , srv1765925486:84 , srv1799202164:84 , srv1823274127:84 , srv1850353724:84 , srv186493363:84 , srv2024494612:84 , srv2024956774:84 , srv2037846846:84 , srv22881692:84 , srv253345300:84 , srv306663465:84 , srv325225417:84 , srv397159771:84 , srv462274777:84 , srv47296453:84 , srv478380897:84 , srv538885127:84 , srv560878998:84 , srv705724568:84 , srv744101719:84 , srv799406136:84 , srv804879228:84 , srv876485369:84 , srv95090165:84 , srv980770242:84 , srv1040865205:85 , srv1041387117:85 , srv1084572011:85 , srv1108367405:85 , srv1159999230:85 , srv1186621071:85 , srv1190289862:85 , srv1196494380:85 , srv1214679142:85 , srv1259633990:85 , srv1347811750:85 , srv1354474606:85 , srv1393109384:85 , srv1426312966:85 , srv1478441607:85 , srv1540869147:85 , srv1579622155:85 , srv1705450293:85 , srv1715147966:85 , srv1754362226:85 , srv1767303418:85 , srv1807480027:85 , srv1819747761:85 , srv1888462370:85 , srv1931650294:85 , srv1954203073:85 , srv195452997:85 , srv1976553917:85 , srv1996760187:85 , srv232766465:85 , srv235199148:85 , srv236336291:85 , srv317861438:85 , srv385323676:85 , srv451416684:85 , srv463142964:85 , srv479970032:85 , srv495905944:85 , srv5513396:85 , srv561433850:85 , srv582132662:85 , srv597409251:85 , srv632333995:85 , srv693096040:85 , srv700109746:85 , srv746372110:85 , srv832880738:85 , srv883595732:85 , srv943659211:85 , srv1340748708:86 , srv1671254300:86 , srv1711320852:86 , srv1930844801:86 , srv481578729:86 , srv646099505:86 , srv654557757:86 , srv881308802:86 , srv411159448:627 }
2023-11-01 01:56:53,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:53,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv744101719=88, srv538885127=76, srv1084572011=3, srv799406136=90, srv1671701286=30, srv705724568=87, srv232766465=58, srv397159771=66, srv178997599=40, srv462274777=69, srv632333995=82, srv1807480027=42, srv597409251=81, srv943659211=97, srv2024494612=54, srv478380897=72, srv1321616950=15, srv1478441607=24, srv2024956774=55, srv1711320852=34, srv700109746=86, srv1041387117=1, srv1714873610=35, srv481578729=74, srv928960903=96, srv1765925486=38, srv1715147966=36, srv1142485276=6, srv1313576884=14, srv883595732=95, srv1196494380=11, srv1930844801=48, srv1702761072=32, srv236336291=60, srv1042944084=2, srv1540869147=26, srv385323676=65, srv463142964=70, srv1393109384=19, srv1767303418=39, srv1799202164=41, srv306663465=62, srv47296453=71, srv654557757=84, srv253345300=61, srv1888462370=47, srv411159448=67, srv876485369=93, srv1394171=20, srv746372110=89, srv561433850=79, srv142164663=21, srv1259633990=13, srv5513396=77, srv1996760187=53, srv1186621071=9, srv1354474606=18, srv1823274127=44, srv325225417=64, srv479970032=73, srv22881692=57, srv1671254300=29, srv1504353654=25, srv1579622155=28, srv646099505=83, srv881308802=94, srv1475969830=23, srv117379840=8, srv560878998=78, srv1340748708=16, srv1976553917=52, srv1159999230=7, srv1754362226=37, srv495905944=75, srv1347811750=17, srv1569013787=27, srv1190289862=10, srv1931650294=49, srv317861438=63, srv980770242=99, srv186493363=46, srv1108367405=4, srv582132662=80, srv1214679142=12, srv804879228=91, srv1819747761=43, srv832880738=92, srv1954203073=50, srv693096040=85, srv1130865929=5, srv451416684=68, srv1426312966=22, srv95090165=98, srv1686098228=31, srv1705450293=33, srv1040865205=0, srv1850353724=45, srv2037846846=56, srv195452997=51, srv235199148=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:53,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:53,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:53,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:53,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-01 01:56:53,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-01 01:56:53,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-01 01:56:53,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-01 01:56:53,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-01 01:56:53,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-01 01:56:53,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-01 01:56:53,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-01 01:56:53,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-01 01:56:53,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-01 01:56:53,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-01 01:56:53,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-01 01:56:53,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-01 01:56:53,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-01 01:56:53,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:53,871 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-01 01:56:53,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.284051109172096E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-01 01:56:54,020 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 221 ms to try 5000 different iterations.  Found a solution that moves 39 regions; Going from a computed imbalance of 6.284051109172096E-5 to a new imbalance of 6.3051625764662476E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.004333333333333333); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:54,021 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1579622155:83 , srv1705450293:83 , srv1711320852:83 , srv186493363:83 , srv1930844801:83 , srv1931650294:83 , srv232766465:83 , srv385323676:83 , srv481578729:83 , srv646099505:83 , srv881308802:83 , srv943659211:83 , srv1040865205:84 , srv1041387117:84 , srv1042944084:84 , srv1084572011:84 , srv1108367405:84 , srv1130865929:84 , srv1159999230:84 , srv117379840:84 , srv1186621071:84 , srv1190289862:84 , srv1196494380:84 , srv1214679142:84 , srv1259633990:84 , srv1340748708:84 , srv1347811750:84 , srv1354474606:84 , srv1393109384:84 , srv1394171:84 , srv142164663:84 , srv1426312966:84 , srv1478441607:84 , srv1504353654:84 , srv1540869147:84 , srv1671254300:84 , srv1671701286:84 , srv1686098228:84 , srv1702761072:84 , srv1715147966:84 , srv1754362226:84 , srv1765925486:84 , srv1767303418:84 , srv178997599:84 , srv1799202164:84 , srv1807480027:84 , srv1819747761:84 , srv1823274127:84 , srv1850353724:84 , srv1954203073:84 , srv195452997:84 , srv1976553917:84 , srv1996760187:84 , srv2024494612:84 , srv2024956774:84 , srv22881692:84 , srv235199148:84 , srv236336291:84 , srv253345300:84 , srv306663465:84 , srv317861438:84 , srv325225417:84 , srv397159771:84 , srv451416684:84 , srv462274777:84 , srv463142964:84 , srv478380897:84 , srv479970032:84 , srv495905944:84 , srv538885127:84 , srv5513396:84 , srv560878998:84 , srv561433850:84 , srv582132662:84 , srv597409251:84 , srv632333995:84 , srv654557757:84 , srv693096040:84 , srv700109746:84 , srv705724568:84 , srv744101719:84 , srv746372110:84 , srv799406136:84 , srv832880738:84 , srv876485369:84 , srv883595732:84 , srv95090165:84 , srv1142485276:85 , srv1313576884:85 , srv1321616950:85 , srv1475969830:85 , srv1569013787:85 , srv1714873610:85 , srv1888462370:85 , srv2037846846:85 , srv47296453:85 , srv804879228:85 , srv928960903:85 , srv980770242:85 , srv411159448:684 }
2023-11-01 01:56:54,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:54,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv744101719=88, srv538885127=76, srv1084572011=3, srv799406136=90, srv1671701286=30, srv705724568=87, srv232766465=58, srv397159771=66, srv178997599=40, srv462274777=69, srv632333995=82, srv1807480027=42, srv597409251=81, srv943659211=97, srv2024494612=54, srv478380897=72, srv1321616950=15, srv1478441607=24, srv2024956774=55, srv1711320852=34, srv700109746=86, srv1041387117=1, srv1714873610=35, srv481578729=74, srv928960903=96, srv1765925486=38, srv1715147966=36, srv1142485276=6, srv1313576884=14, srv883595732=95, srv1196494380=11, srv1930844801=48, srv1702761072=32, srv236336291=60, srv1042944084=2, srv1540869147=26, srv385323676=65, srv463142964=70, srv1393109384=19, srv1767303418=39, srv1799202164=41, srv306663465=62, srv47296453=71, srv654557757=84, srv253345300=61, srv1888462370=47, srv411159448=67, srv876485369=93, srv1394171=20, srv746372110=89, srv561433850=79, srv142164663=21, srv1259633990=13, srv5513396=77, srv1996760187=53, srv1186621071=9, srv1354474606=18, srv1823274127=44, srv325225417=64, srv479970032=73, srv22881692=57, srv1671254300=29, srv1504353654=25, srv1579622155=28, srv646099505=83, srv881308802=94, srv1475969830=23, srv117379840=8, srv560878998=78, srv1340748708=16, srv1976553917=52, srv1159999230=7, srv1754362226=37, srv495905944=75, srv1347811750=17, srv1569013787=27, srv1190289862=10, srv1931650294=49, srv317861438=63, srv980770242=99, srv186493363=46, srv1108367405=4, srv582132662=80, srv1214679142=12, srv804879228=91, srv1819747761=43, srv832880738=92, srv1954203073=50, srv693096040=85, srv1130865929=5, srv451416684=68, srv1426312966=22, srv95090165=98, srv1686098228=31, srv1705450293=33, srv1040865205=0, srv1850353724=45, srv2037846846=56, srv195452997=51, srv235199148=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:54,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-01 01:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-01 01:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-01 01:56:54,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-01 01:56:54,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-01 01:56:54,118 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:54,118 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1579622155:83 , srv1705450293:83 , srv1711320852:83 , srv186493363:83 , srv1930844801:83 , srv1931650294:83 , srv232766465:83 , srv385323676:83 , srv481578729:83 , srv646099505:83 , srv881308802:83 , srv943659211:83 , srv1040865205:84 , srv1041387117:84 , srv1042944084:84 , srv1084572011:84 , srv1108367405:84 , srv1130865929:84 , srv1159999230:84 , srv117379840:84 , srv1186621071:84 , srv1190289862:84 , srv1196494380:84 , srv1214679142:84 , srv1259633990:84 , srv1340748708:84 , srv1347811750:84 , srv1354474606:84 , srv1393109384:84 , srv1394171:84 , srv142164663:84 , srv1426312966:84 , srv1478441607:84 , srv1504353654:84 , srv1540869147:84 , srv1671254300:84 , srv1671701286:84 , srv1686098228:84 , srv1702761072:84 , srv1715147966:84 , srv1754362226:84 , srv1765925486:84 , srv1767303418:84 , srv178997599:84 , srv1799202164:84 , srv1807480027:84 , srv1819747761:84 , srv1823274127:84 , srv1850353724:84 , srv1954203073:84 , srv195452997:84 , srv1976553917:84 , srv1996760187:84 , srv2024494612:84 , srv2024956774:84 , srv22881692:84 , srv235199148:84 , srv236336291:84 , srv253345300:84 , srv306663465:84 , srv317861438:84 , srv325225417:84 , srv397159771:84 , srv451416684:84 , srv462274777:84 , srv463142964:84 , srv478380897:84 , srv479970032:84 , srv495905944:84 , srv538885127:84 , srv5513396:84 , srv560878998:84 , srv561433850:84 , srv582132662:84 , srv597409251:84 , srv632333995:84 , srv654557757:84 , srv693096040:84 , srv700109746:84 , srv705724568:84 , srv744101719:84 , srv746372110:84 , srv799406136:84 , srv832880738:84 , srv876485369:84 , srv883595732:84 , srv95090165:84 , srv1142485276:85 , srv1313576884:85 , srv1321616950:85 , srv1475969830:85 , srv1569013787:85 , srv1714873610:85 , srv1888462370:85 , srv2037846846:85 , srv47296453:85 , srv804879228:85 , srv928960903:85 , srv980770242:85 , srv411159448:684 }
2023-11-01 01:56:54,143 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 155), ProcessCount=169 (was 169), AvailableMemoryMB=6642 (was 7130)
2023-11-01 01:56:54,149 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=169, AvailableMemoryMB=6641
2023-11-01 01:56:54,150 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-01 01:56:54,150 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-01 01:56:54,158 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1079156311:84 , srv1088964032:84 , srv1160964352:84 , srv1205065226:84 , srv1315797489:84 , srv1377381429:84 , srv1401502148:84 , srv1522365618:84 , srv1632990370:84 , srv1802223667:84 , srv1842794070:84 , srv1849794258:84 , srv1860434476:84 , srv1902376286:84 , srv2013647101:84 , srv2034538621:84 , srv273502833:84 , srv288976380:84 , srv477705497:84 , srv504791376:84 , srv681126307:84 , srv777791696:84 , srv842835712:84 , srv883416356:84 , srv887272484:84 , srv909240457:84 , srv967625933:84 , srv981862772:84 , srv988677013:84 , srv642528959:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-01 01:56:54,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:56:54,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1160964352=2, srv1860434476=12, srv887272484=25, srv681126307=21, srv1632990370=8, srv1802223667=9, srv477705497=18, srv288976380=17, srv2013647101=14, srv967625933=27, srv1315797489=4, srv1377381429=5, srv981862772=28, srv1849794258=11, srv1522365618=7, srv1842794070=10, srv883416356=24, srv909240457=26, srv1205065226=3, srv642528959=20, srv1079156311=0, srv1401502148=6, srv1088964032=1, srv2034538621=15, srv1902376286=13, srv777791696=22, srv504791376=19, srv988677013=29, srv273502833=16, srv842835712=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:56:54,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:56:54,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:56:54,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:56:54,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:56:54,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:56:54,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:56:54,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:56:54,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:56:54,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:56:54,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-01 01:56:54,180 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.148428601641083, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:56:54,181 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912660736941411, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.148428601641083, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-01 01:58:54,171 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9305776 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912660736941411 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:58:54,176 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1079156311:90 , srv1088964032:90 , srv1160964352:90 , srv1205065226:90 , srv1315797489:90 , srv1377381429:90 , srv1401502148:90 , srv1522365618:90 , srv1632990370:90 , srv1802223667:90 , srv1842794070:90 , srv1849794258:90 , srv1860434476:90 , srv1902376286:90 , srv2013647101:90 , srv2034538621:90 , srv273502833:90 , srv288976380:90 , srv477705497:90 , srv504791376:90 , srv642528959:90 , srv681126307:90 , srv777791696:90 , srv842835712:90 , srv883416356:90 , srv887272484:90 , srv909240457:90 , srv967625933:90 , srv981862772:90 , srv988677013:90 }
2023-11-01 01:58:54,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-01 01:58:54,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1160964352=2, srv1860434476=12, srv887272484=25, srv681126307=21, srv1632990370=8, srv1802223667=9, srv477705497=18, srv288976380=17, srv2013647101=14, srv967625933=27, srv1315797489=4, srv1377381429=5, srv981862772=28, srv1849794258=11, srv1522365618=7, srv1842794070=10, srv883416356=24, srv909240457=26, srv1205065226=3, srv642528959=20, srv1079156311=0, srv1401502148=6, srv1088964032=1, srv2034538621=15, srv1902376286=13, srv777791696=22, srv504791376=19, srv988677013=29, srv273502833=16, srv842835712=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-01 01:58:54,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-01 01:58:54,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-01 01:58:54,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-01 01:58:54,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-01 01:58:54,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-01 01:58:54,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-01 01:58:54,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-01 01:58:54,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-01 01:58:54,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-01 01:58:54,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-01 01:58:54,191 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-01 01:58:54,191 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1079156311:90 , srv1088964032:90 , srv1160964352:90 , srv1205065226:90 , srv1315797489:90 , srv1377381429:90 , srv1401502148:90 , srv1522365618:90 , srv1632990370:90 , srv1802223667:90 , srv1842794070:90 , srv1849794258:90 , srv1860434476:90 , srv1902376286:90 , srv2013647101:90 , srv2034538621:90 , srv273502833:90 , srv288976380:90 , srv477705497:90 , srv504791376:90 , srv642528959:90 , srv681126307:90 , srv777791696:90 , srv842835712:90 , srv883416356:90 , srv887272484:90 , srv909240457:90 , srv967625933:90 , srv981862772:90 , srv988677013:90 }
2023-11-01 01:58:54,202 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 155) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 169), AvailableMemoryMB=6884 (was 6641) - AvailableMemoryMB LEAK? -