2023-02-22 01:53:58,148 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-22 01:53:58,507 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-22 01:53:58,633 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-22 01:53:58,699 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-22 01:53:58,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-22 01:53:58,721 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=264, ProcessCount=172, AvailableMemoryMB=8201
2023-02-22 01:53:58,723 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-22 01:53:58,723 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-22 01:53:58,864 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1065173053:84 , srv1067134017:84 , srv1099543702:84 , srv1157698480:84 , srv1170079455:84 , srv1175488138:84 , srv1202112182:84 , srv120736107:84 , srv1269895053:84 , srv1282682248:84 , srv1283107115:84 , srv1301658865:84 , srv1303333050:84 , srv1325897226:84 , srv1350450235:84 , srv1365284747:84 , srv137182702:84 , srv1373524564:84 , srv141585110:84 , srv1428166291:84 , srv1473722057:84 , srv1481418656:84 , srv1522581602:84 , srv1543324729:84 , srv1567576326:84 , srv1576220278:84 , srv1622028358:84 , srv1632752210:84 , srv1633007057:84 , srv1640067847:84 , srv1680247277:84 , srv1700416480:84 , srv1700759837:84 , srv1705807490:84 , srv1758588324:84 , srv1771228791:84 , srv1820157500:84 , srv1855113220:84 , srv1892855456:84 , srv190206735:84 , srv1915818079:84 , srv1980801262:84 , srv2013254505:84 , srv2050973400:84 , srv2054581699:84 , srv2064398896:84 , srv2071571514:84 , srv2122224205:84 , srv244723560:84 , srv254005938:84 , srv257100412:84 , srv258382127:84 , srv2613557:84 , srv298041041:84 , srv303111367:84 , srv309527636:84 , srv361140071:84 , srv361324361:84 , srv366047481:84 , srv371355011:84 , srv376731216:84 , srv382076777:84 , srv394928088:84 , srv410371438:84 , srv472904609:84 , srv473668015:84 , srv514690535:84 , srv52566042:84 , srv531569710:84 , srv537147664:84 , srv555761733:84 , srv556732401:84 , srv619807474:84 , srv625246617:84 , srv674532774:84 , srv689363571:84 , srv73027594:84 , srv75195552:84 , srv758487556:84 , srv78570305:84 , srv799678326:84 , srv811679107:84 , srv825714369:84 , srv827274824:84 , srv829458074:84 , srv83607675:84 , srv855673524:84 , srv875224405:84 , srv875445219:84 , srv876091482:84 , srv900715781:84 , srv900986681:84 , srv902656355:84 , srv912340046:84 , srv925073122:84 , srv951278115:84 , srv978808511:84 , srv980784745:84 , srv986203341:84 , srv1315257796:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-22 01:53:58,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:53:58,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1350450235=15, srv1282682248=9, srv1680247277=31, srv556732401=72, srv2122224205=48, srv473668015=66, srv1315257796=13, srv902656355=93, srv1202112182=6, srv1705807490=34, srv1915818079=41, srv382076777=62, srv1301658865=11, srv758487556=79, srv2064398896=46, srv619807474=73, srv912340046=94, srv1303333050=12, srv855673524=87, srv986203341=99, srv1632752210=28, srv1576220278=26, srv258382127=52, srv876091482=90, srv120736107=7, srv2071571514=47, srv825714369=83, srv78570305=80, srv811679107=82, srv257100412=51, srv371355011=60, srv376731216=61, srv361140071=57, srv75195552=78, srv361324361=58, srv254005938=50, srv366047481=59, srv827274824=84, srv2054581699=45, srv689363571=76, srv1283107115=10, srv244723560=49, srv829458074=85, srv1269895053=8, srv1980801262=42, srv514690535=67, srv1771228791=36, srv1522581602=23, srv980784745=98, srv625246617=74, srv537147664=70, srv1543324729=24, srv1700759837=33, srv83607675=86, srv137182702=17, srv1481418656=22, srv1567576326=25, srv1065173053=0, srv1700416480=32, srv1892855456=39, srv925073122=95, srv1820157500=37, srv394928088=63, srv141585110=19, srv1157698480=3, srv2613557=53, srv73027594=77, srv2050973400=44, srv1633007057=29, srv875445219=89, srv1325897226=14, srv1473722057=21, srv52566042=68, srv951278115=96, srv1640067847=30, srv531569710=69, srv1428166291=20, srv1373524564=18, srv900715781=91, srv674532774=75, srv1175488138=5, srv1365284747=16, srv1067134017=1, srv1758588324=35, srv978808511=97, srv799678326=81, srv1855113220=38, srv298041041=54, srv190206735=40, srv472904609=65, srv410371438=64, srv900986681=92, srv1622028358=27, srv875224405=88, srv1099543702=2, srv309527636=56, srv1170079455=4, srv2013254505=43, srv303111367=55, srv555761733=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:53:59,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:53:59,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:53:59,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:53:59,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:53:59,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:53:59,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:53:59,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:53:59,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:53:59,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:53:59,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:53:59,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:53:59,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:53:59,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:53:59,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:53:59,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:53:59,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:53:59,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:53:59,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:53:59,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:53:59,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:53:59,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:53:59,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:53:59,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:53:59,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:53:59,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:53:59,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:53:59,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:53:59,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:53:59,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:53:59,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:53:59,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-22 01:53:59,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-22 01:53:59,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-22 01:53:59,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-22 01:53:59,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-22 01:53:59,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-22 01:53:59,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-22 01:53:59,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-22 01:53:59,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-22 01:53:59,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-22 01:53:59,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-22 01:53:59,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-22 01:53:59,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-22 01:53:59,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-22 01:53:59,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-22 01:53:59,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-22 01:53:59,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-22 01:53:59,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-22 01:53:59,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-22 01:53:59,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-22 01:53:59,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-22 01:53:59,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-22 01:53:59,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-22 01:53:59,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-22 01:53:59,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-22 01:53:59,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-22 01:53:59,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-22 01:53:59,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-22 01:53:59,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-22 01:53:59,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-22 01:53:59,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-22 01:53:59,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-22 01:53:59,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-22 01:53:59,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-22 01:53:59,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-22 01:53:59,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-22 01:53:59,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-22 01:53:59,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-22 01:53:59,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-22 01:53:59,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-22 01:53:59,247 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:53:59,248 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-22 01:53:59,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-22 01:53:59,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 4672 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18038010284343053. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04036681787106262, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05670131640187861, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5191111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04036681787106262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:53:59,598 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1543324729:82 , srv1481418656:83 , srv1576220278:83 , srv254005938:83 , srv758487556:83 , srv875224405:83 , srv900715781:83 , srv1065173053:84 , srv120736107:84 , srv1303333050:84 , srv1373524564:84 , srv1980801262:84 , srv2013254505:84 , srv303111367:84 , srv366047481:84 , srv410371438:84 , srv52566042:84 , srv556732401:84 , srv689363571:84 , srv1269895053:85 , srv1325897226:85 , srv1350450235:85 , srv1428166291:85 , srv1522581602:85 , srv1758588324:85 , srv2050973400:85 , srv2064398896:85 , srv531569710:85 , srv537147664:85 , srv78570305:85 , srv825714369:85 , srv827274824:85 , srv83607675:85 , srv1067134017:86 , srv1157698480:86 , srv1170079455:86 , srv1175488138:86 , srv1301658865:86 , srv1622028358:86 , srv1632752210:86 , srv1680247277:86 , srv1700416480:86 , srv1771228791:86 , srv1820157500:86 , srv1855113220:86 , srv1915818079:86 , srv2613557:86 , srv298041041:86 , srv309527636:86 , srv371355011:86 , srv555761733:86 , srv619807474:86 , srv625246617:86 , srv674532774:86 , srv75195552:86 , srv829458074:86 , srv855673524:86 , srv980784745:86 , srv1099543702:87 , srv1283107115:87 , srv1633007057:87 , srv1892855456:87 , srv2071571514:87 , srv2122224205:87 , srv258382127:87 , srv361324361:87 , srv376731216:87 , srv382076777:87 , srv473668015:87 , srv73027594:87 , srv799678326:87 , srv811679107:87 , srv875445219:87 , srv912340046:87 , srv925073122:87 , srv951278115:87 , srv986203341:87 , srv1202112182:88 , srv1365284747:88 , srv141585110:88 , srv1473722057:88 , srv1640067847:88 , srv2054581699:88 , srv257100412:88 , srv394928088:88 , srv876091482:88 , srv137182702:89 , srv1705807490:89 , srv190206735:89 , srv244723560:89 , srv1282682248:90 , srv1567576326:90 , srv978808511:90 , srv472904609:91 , srv900986681:91 , srv902656355:91 , srv361140071:92 , srv514690535:92 , srv1700759837:95 , srv1315257796:449 }
2023-02-22 01:53:59,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:53:59,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1350450235=15, srv1282682248=9, srv1680247277=31, srv556732401=72, srv2122224205=48, srv473668015=66, srv1315257796=13, srv902656355=93, srv1202112182=6, srv1705807490=34, srv1915818079=41, srv382076777=62, srv1301658865=11, srv758487556=79, srv2064398896=46, srv619807474=73, srv912340046=94, srv1303333050=12, srv855673524=87, srv986203341=99, srv1632752210=28, srv1576220278=26, srv258382127=52, srv876091482=90, srv120736107=7, srv2071571514=47, srv825714369=83, srv78570305=80, srv811679107=82, srv257100412=51, srv371355011=60, srv376731216=61, srv361140071=57, srv75195552=78, srv361324361=58, srv254005938=50, srv366047481=59, srv827274824=84, srv2054581699=45, srv689363571=76, srv1283107115=10, srv244723560=49, srv829458074=85, srv1269895053=8, srv1980801262=42, srv514690535=67, srv1771228791=36, srv1522581602=23, srv980784745=98, srv625246617=74, srv537147664=70, srv1543324729=24, srv1700759837=33, srv83607675=86, srv137182702=17, srv1481418656=22, srv1567576326=25, srv1065173053=0, srv1700416480=32, srv1892855456=39, srv925073122=95, srv1820157500=37, srv394928088=63, srv141585110=19, srv1157698480=3, srv2613557=53, srv73027594=77, srv2050973400=44, srv1633007057=29, srv875445219=89, srv1325897226=14, srv1473722057=21, srv52566042=68, srv951278115=96, srv1640067847=30, srv531569710=69, srv1428166291=20, srv1373524564=18, srv900715781=91, srv674532774=75, srv1175488138=5, srv1365284747=16, srv1067134017=1, srv1758588324=35, srv978808511=97, srv799678326=81, srv1855113220=38, srv298041041=54, srv190206735=40, srv472904609=65, srv410371438=64, srv900986681=92, srv1622028358=27, srv875224405=88, srv1099543702=2, srv309527636=56, srv1170079455=4, srv2013254505=43, srv303111367=55, srv555761733=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:53:59,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:53:59,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:53:59,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:53:59,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-22 01:53:59,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-22 01:53:59,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-22 01:53:59,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-22 01:53:59,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-22 01:53:59,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-22 01:53:59,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-22 01:53:59,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-22 01:53:59,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04036681787106262, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05670131640187861, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04036681787106262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:53:59,779 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-22 01:53:59,779 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18034738880021928, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04036681787106262, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05670131640187861, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04036681787106262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-22 01:54:00,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 382 ms to try 5000 different iterations.  Found a solution that moves 2664 regions; Going from a computed imbalance of 0.18034738880021928 to a new imbalance of 0.015110128803461749. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02273866780053989); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036634512990997195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02273866780053989); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:00,063 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1700759837:75 , srv902656355:79 , srv361140071:80 , srv900986681:80 , srv472904609:81 , srv514690535:81 , srv190206735:82 , srv1157698480:83 , srv1202112182:83 , srv137182702:83 , srv1473722057:83 , srv1705807490:83 , srv1892855456:83 , srv257100412:83 , srv1067134017:84 , srv1283107115:84 , srv141585110:84 , srv1567576326:84 , srv2050973400:84 , srv2054581699:84 , srv244723560:84 , srv298041041:84 , srv394928088:84 , srv799678326:84 , srv811679107:84 , srv925073122:84 , srv978808511:84 , srv980784745:84 , srv1099543702:85 , srv1175488138:85 , srv1282682248:85 , srv1325897226:85 , srv1350450235:85 , srv1680247277:85 , srv1771228791:85 , srv1855113220:85 , srv2064398896:85 , srv2071571514:85 , srv309527636:85 , srv366047481:85 , srv376731216:85 , srv473668015:85 , srv537147664:85 , srv73027594:85 , srv827274824:85 , srv876091482:85 , srv951278115:85 , srv1170079455:86 , srv1269895053:86 , srv1303333050:86 , srv1365284747:86 , srv1522581602:86 , srv1622028358:86 , srv1633007057:86 , srv2013254505:86 , srv2122224205:86 , srv254005938:86 , srv2613557:86 , srv303111367:86 , srv619807474:86 , srv625246617:86 , srv78570305:86 , srv912340046:86 , srv1632752210:87 , srv1640067847:87 , srv1758588324:87 , srv1820157500:87 , srv1915818079:87 , srv258382127:87 , srv361324361:87 , srv382076777:87 , srv556732401:87 , srv674532774:87 , srv689363571:87 , srv758487556:87 , srv829458074:87 , srv83607675:87 , srv855673524:87 , srv986203341:87 , srv120736107:88 , srv1373524564:88 , srv1428166291:88 , srv1700416480:88 , srv1980801262:88 , srv371355011:88 , srv531569710:88 , srv75195552:88 , srv900715781:88 , srv1301658865:89 , srv1481418656:89 , srv1543324729:89 , srv1576220278:89 , srv410371438:89 , srv555761733:89 , srv825714369:89 , srv1065173053:90 , srv52566042:90 , srv875224405:90 , srv875445219:90 , srv1315257796:527 }
2023-02-22 01:54:00,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:54:00,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1350450235=15, srv1282682248=9, srv1680247277=31, srv556732401=72, srv2122224205=48, srv473668015=66, srv1315257796=13, srv902656355=93, srv1202112182=6, srv1705807490=34, srv1915818079=41, srv382076777=62, srv1301658865=11, srv758487556=79, srv2064398896=46, srv619807474=73, srv912340046=94, srv1303333050=12, srv855673524=87, srv986203341=99, srv1632752210=28, srv1576220278=26, srv258382127=52, srv876091482=90, srv120736107=7, srv2071571514=47, srv825714369=83, srv78570305=80, srv811679107=82, srv257100412=51, srv371355011=60, srv376731216=61, srv361140071=57, srv75195552=78, srv361324361=58, srv254005938=50, srv366047481=59, srv827274824=84, srv2054581699=45, srv689363571=76, srv1283107115=10, srv244723560=49, srv829458074=85, srv1269895053=8, srv1980801262=42, srv514690535=67, srv1771228791=36, srv1522581602=23, srv980784745=98, srv625246617=74, srv537147664=70, srv1543324729=24, srv1700759837=33, srv83607675=86, srv137182702=17, srv1481418656=22, srv1567576326=25, srv1065173053=0, srv1700416480=32, srv1892855456=39, srv925073122=95, srv1820157500=37, srv394928088=63, srv141585110=19, srv1157698480=3, srv2613557=53, srv73027594=77, srv2050973400=44, srv1633007057=29, srv875445219=89, srv1325897226=14, srv1473722057=21, srv52566042=68, srv951278115=96, srv1640067847=30, srv531569710=69, srv1428166291=20, srv1373524564=18, srv900715781=91, srv674532774=75, srv1175488138=5, srv1365284747=16, srv1067134017=1, srv1758588324=35, srv978808511=97, srv799678326=81, srv1855113220=38, srv298041041=54, srv190206735=40, srv472904609=65, srv410371438=64, srv900986681=92, srv1622028358=27, srv875224405=88, srv1099543702=2, srv309527636=56, srv1170079455=4, srv2013254505=43, srv303111367=55, srv555761733=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:54:00,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:54:00,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:54:00,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-22 01:54:00,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-22 01:54:00,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-22 01:54:00,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-22 01:54:00,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-22 01:54:00,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-22 01:54:00,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02273866780053989); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036634512990997195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02273866780053989); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:00,214 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-22 01:54:00,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015091475076767653, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02273866780053989); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036634512990997195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02273866780053989); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-22 01:54:00,494 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.015091475076767653 to a new imbalance of 9.421741871669621E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005438726698250852); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008619660142094213); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005438726698250852); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:00,495 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv875445219:81 , srv1282682248:83 , srv1301658865:83 , srv1567576326:83 , srv1700416480:83 , srv361324361:83 , srv382076777:83 , srv52566042:83 , srv555761733:83 , srv978808511:83 , srv1065173053:84 , srv1428166291:84 , srv1632752210:84 , srv1640067847:84 , srv1820157500:84 , srv2054581699:84 , srv2122224205:84 , srv244723560:84 , srv258382127:84 , srv371355011:84 , srv75195552:84 , srv825714369:84 , srv829458074:84 , srv875224405:84 , srv986203341:84 , srv137182702:85 , srv1373524564:85 , srv141585110:85 , srv1481418656:85 , srv1622028358:85 , srv1633007057:85 , srv1758588324:85 , srv1915818079:85 , srv1980801262:85 , srv2071571514:85 , srv2613557:85 , srv361140071:85 , srv394928088:85 , srv410371438:85 , srv472904609:85 , srv514690535:85 , srv531569710:85 , srv674532774:85 , srv73027594:85 , srv83607675:85 , srv855673524:85 , srv876091482:85 , srv912340046:85 , srv951278115:85 , srv1099543702:86 , srv1170079455:86 , srv120736107:86 , srv1325897226:86 , srv1365284747:86 , srv1473722057:86 , srv1522581602:86 , srv1543324729:86 , srv1576220278:86 , srv1680247277:86 , srv1855113220:86 , srv257100412:86 , srv309527636:86 , srv376731216:86 , srv619807474:86 , srv625246617:86 , srv689363571:86 , srv799678326:86 , srv811679107:86 , srv900715781:86 , srv900986681:86 , srv1067134017:87 , srv1175488138:87 , srv1202112182:87 , srv1269895053:87 , srv1283107115:87 , srv1705807490:87 , srv1771228791:87 , srv1892855456:87 , srv190206735:87 , srv2013254505:87 , srv298041041:87 , srv473668015:87 , srv537147664:87 , srv556732401:87 , srv758487556:87 , srv78570305:87 , srv925073122:87 , srv980784745:87 , srv1157698480:88 , srv1303333050:88 , srv1350450235:88 , srv2050973400:88 , srv254005938:88 , srv303111367:88 , srv366047481:88 , srv827274824:88 , srv902656355:88 , srv1700759837:89 , srv2064398896:89 , srv1315257796:530 }
2023-02-22 01:54:00,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:54:00,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1350450235=15, srv1282682248=9, srv1680247277=31, srv556732401=72, srv2122224205=48, srv473668015=66, srv1315257796=13, srv902656355=93, srv1202112182=6, srv1705807490=34, srv1915818079=41, srv382076777=62, srv1301658865=11, srv758487556=79, srv2064398896=46, srv619807474=73, srv912340046=94, srv1303333050=12, srv855673524=87, srv986203341=99, srv1632752210=28, srv1576220278=26, srv258382127=52, srv876091482=90, srv120736107=7, srv2071571514=47, srv825714369=83, srv78570305=80, srv811679107=82, srv257100412=51, srv371355011=60, srv376731216=61, srv361140071=57, srv75195552=78, srv361324361=58, srv254005938=50, srv366047481=59, srv827274824=84, srv2054581699=45, srv689363571=76, srv1283107115=10, srv244723560=49, srv829458074=85, srv1269895053=8, srv1980801262=42, srv514690535=67, srv1771228791=36, srv1522581602=23, srv980784745=98, srv625246617=74, srv537147664=70, srv1543324729=24, srv1700759837=33, srv83607675=86, srv137182702=17, srv1481418656=22, srv1567576326=25, srv1065173053=0, srv1700416480=32, srv1892855456=39, srv925073122=95, srv1820157500=37, srv394928088=63, srv141585110=19, srv1157698480=3, srv2613557=53, srv73027594=77, srv2050973400=44, srv1633007057=29, srv875445219=89, srv1325897226=14, srv1473722057=21, srv52566042=68, srv951278115=96, srv1640067847=30, srv531569710=69, srv1428166291=20, srv1373524564=18, srv900715781=91, srv674532774=75, srv1175488138=5, srv1365284747=16, srv1067134017=1, srv1758588324=35, srv978808511=97, srv799678326=81, srv1855113220=38, srv298041041=54, srv190206735=40, srv472904609=65, srv410371438=64, srv900986681=92, srv1622028358=27, srv875224405=88, srv1099543702=2, srv309527636=56, srv1170079455=4, srv2013254505=43, srv303111367=55, srv555761733=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-22 01:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-22 01:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-22 01:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-22 01:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-22 01:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-22 01:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-22 01:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-22 01:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-22 01:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-22 01:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-22 01:54:00,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005438726698250852); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008619660142094213); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005438726698250852); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:00,662 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-22 01:54:00,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.352630654525959E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005438726698250852); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008619660142094213); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005438726698250852); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-22 01:54:00,999 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 296 regions; Going from a computed imbalance of 9.352630654525959E-4 to a new imbalance of 3.524469453578909E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.03288888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:01,000 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1365284747:82 , srv1640067847:83 , srv1700759837:83 , srv2064398896:83 , srv555761733:83 , srv1067134017:84 , srv1157698480:84 , srv1170079455:84 , srv1202112182:84 , srv120736107:84 , srv1269895053:84 , srv1282682248:84 , srv1283107115:84 , srv1301658865:84 , srv1350450235:84 , srv137182702:84 , srv1576220278:84 , srv1633007057:84 , srv1705807490:84 , srv1771228791:84 , srv1820157500:84 , srv1915818079:84 , srv254005938:84 , srv258382127:84 , srv303111367:84 , srv371355011:84 , srv376731216:84 , srv394928088:84 , srv410371438:84 , srv473668015:84 , srv514690535:84 , srv531569710:84 , srv556732401:84 , srv619807474:84 , srv625246617:84 , srv674532774:84 , srv73027594:84 , srv75195552:84 , srv825714369:84 , srv827274824:84 , srv829458074:84 , srv875445219:84 , srv876091482:84 , srv902656355:84 , srv912340046:84 , srv925073122:84 , srv986203341:84 , srv1065173053:85 , srv1099543702:85 , srv1175488138:85 , srv1303333050:85 , srv1373524564:85 , srv141585110:85 , srv1428166291:85 , srv1473722057:85 , srv1481418656:85 , srv1522581602:85 , srv1543324729:85 , srv1567576326:85 , srv1622028358:85 , srv1632752210:85 , srv1680247277:85 , srv1700416480:85 , srv1758588324:85 , srv1855113220:85 , srv1892855456:85 , srv190206735:85 , srv1980801262:85 , srv2013254505:85 , srv2050973400:85 , srv2054581699:85 , srv2071571514:85 , srv2122224205:85 , srv244723560:85 , srv257100412:85 , srv2613557:85 , srv298041041:85 , srv309527636:85 , srv361140071:85 , srv361324361:85 , srv366047481:85 , srv382076777:85 , srv472904609:85 , srv52566042:85 , srv537147664:85 , srv689363571:85 , srv758487556:85 , srv78570305:85 , srv799678326:85 , srv811679107:85 , srv83607675:85 , srv855673524:85 , srv900715781:85 , srv900986681:85 , srv951278115:85 , srv978808511:85 , srv980784745:85 , srv1325897226:86 , srv875224405:86 , srv1315257796:636 }
2023-02-22 01:54:01,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:54:01,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1350450235=15, srv1282682248=9, srv1680247277=31, srv556732401=72, srv2122224205=48, srv473668015=66, srv1315257796=13, srv902656355=93, srv1202112182=6, srv1705807490=34, srv1915818079=41, srv382076777=62, srv1301658865=11, srv758487556=79, srv2064398896=46, srv619807474=73, srv912340046=94, srv1303333050=12, srv855673524=87, srv986203341=99, srv1632752210=28, srv1576220278=26, srv258382127=52, srv876091482=90, srv120736107=7, srv2071571514=47, srv825714369=83, srv78570305=80, srv811679107=82, srv257100412=51, srv371355011=60, srv376731216=61, srv361140071=57, srv75195552=78, srv361324361=58, srv254005938=50, srv366047481=59, srv827274824=84, srv2054581699=45, srv689363571=76, srv1283107115=10, srv244723560=49, srv829458074=85, srv1269895053=8, srv1980801262=42, srv514690535=67, srv1771228791=36, srv1522581602=23, srv980784745=98, srv625246617=74, srv537147664=70, srv1543324729=24, srv1700759837=33, srv83607675=86, srv137182702=17, srv1481418656=22, srv1567576326=25, srv1065173053=0, srv1700416480=32, srv1892855456=39, srv925073122=95, srv1820157500=37, srv394928088=63, srv141585110=19, srv1157698480=3, srv2613557=53, srv73027594=77, srv2050973400=44, srv1633007057=29, srv875445219=89, srv1325897226=14, srv1473722057=21, srv52566042=68, srv951278115=96, srv1640067847=30, srv531569710=69, srv1428166291=20, srv1373524564=18, srv900715781=91, srv674532774=75, srv1175488138=5, srv1365284747=16, srv1067134017=1, srv1758588324=35, srv978808511=97, srv799678326=81, srv1855113220=38, srv298041041=54, srv190206735=40, srv472904609=65, srv410371438=64, srv900986681=92, srv1622028358=27, srv875224405=88, srv1099543702=2, srv309527636=56, srv1170079455=4, srv2013254505=43, srv303111367=55, srv555761733=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:54:01,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:54:01,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-22 01:54:01,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-22 01:54:01,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-22 01:54:01,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-22 01:54:01,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-22 01:54:01,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-22 01:54:01,160 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:01,161 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-22 01:54:01,161 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.317205823644519E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-22 01:54:01,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 371 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 3.317205823644519E-5 to a new imbalance of 6.919122795330589E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:01,419 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1065173053:83 , srv1099543702:83 , srv1175488138:83 , srv1303333050:83 , srv1705807490:83 , srv190206735:83 , srv473668015:83 , srv78570305:83 , srv855673524:83 , srv875224405:83 , srv1170079455:84 , srv1202112182:84 , srv120736107:84 , srv1269895053:84 , srv1282682248:84 , srv1283107115:84 , srv1301658865:84 , srv1325897226:84 , srv1350450235:84 , srv1365284747:84 , srv1373524564:84 , srv141585110:84 , srv1428166291:84 , srv1473722057:84 , srv1481418656:84 , srv1522581602:84 , srv1543324729:84 , srv1567576326:84 , srv1576220278:84 , srv1622028358:84 , srv1632752210:84 , srv1633007057:84 , srv1640067847:84 , srv1680247277:84 , srv1700416480:84 , srv1700759837:84 , srv1758588324:84 , srv1771228791:84 , srv1855113220:84 , srv1892855456:84 , srv1915818079:84 , srv1980801262:84 , srv2013254505:84 , srv2050973400:84 , srv2064398896:84 , srv2071571514:84 , srv2122224205:84 , srv244723560:84 , srv257100412:84 , srv258382127:84 , srv2613557:84 , srv298041041:84 , srv303111367:84 , srv309527636:84 , srv361140071:84 , srv361324361:84 , srv366047481:84 , srv371355011:84 , srv376731216:84 , srv382076777:84 , srv410371438:84 , srv472904609:84 , srv514690535:84 , srv52566042:84 , srv531569710:84 , srv537147664:84 , srv556732401:84 , srv619807474:84 , srv625246617:84 , srv674532774:84 , srv689363571:84 , srv75195552:84 , srv758487556:84 , srv799678326:84 , srv811679107:84 , srv825714369:84 , srv827274824:84 , srv83607675:84 , srv875445219:84 , srv876091482:84 , srv900715781:84 , srv900986681:84 , srv902656355:84 , srv912340046:84 , srv925073122:84 , srv951278115:84 , srv978808511:84 , srv980784745:84 , srv986203341:84 , srv1067134017:85 , srv1157698480:85 , srv137182702:85 , srv1820157500:85 , srv2054581699:85 , srv254005938:85 , srv394928088:85 , srv555761733:85 , srv73027594:85 , srv829458074:85 , srv1315257796:684 }
2023-02-22 01:54:01,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:54:01,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1350450235=15, srv1282682248=9, srv1680247277=31, srv556732401=72, srv2122224205=48, srv473668015=66, srv1315257796=13, srv902656355=93, srv1202112182=6, srv1705807490=34, srv1915818079=41, srv382076777=62, srv1301658865=11, srv758487556=79, srv2064398896=46, srv619807474=73, srv912340046=94, srv1303333050=12, srv855673524=87, srv986203341=99, srv1632752210=28, srv1576220278=26, srv258382127=52, srv876091482=90, srv120736107=7, srv2071571514=47, srv825714369=83, srv78570305=80, srv811679107=82, srv257100412=51, srv371355011=60, srv376731216=61, srv361140071=57, srv75195552=78, srv361324361=58, srv254005938=50, srv366047481=59, srv827274824=84, srv2054581699=45, srv689363571=76, srv1283107115=10, srv244723560=49, srv829458074=85, srv1269895053=8, srv1980801262=42, srv514690535=67, srv1771228791=36, srv1522581602=23, srv980784745=98, srv625246617=74, srv537147664=70, srv1543324729=24, srv1700759837=33, srv83607675=86, srv137182702=17, srv1481418656=22, srv1567576326=25, srv1065173053=0, srv1700416480=32, srv1892855456=39, srv925073122=95, srv1820157500=37, srv394928088=63, srv141585110=19, srv1157698480=3, srv2613557=53, srv73027594=77, srv2050973400=44, srv1633007057=29, srv875445219=89, srv1325897226=14, srv1473722057=21, srv52566042=68, srv951278115=96, srv1640067847=30, srv531569710=69, srv1428166291=20, srv1373524564=18, srv900715781=91, srv674532774=75, srv1175488138=5, srv1365284747=16, srv1067134017=1, srv1758588324=35, srv978808511=97, srv799678326=81, srv1855113220=38, srv298041041=54, srv190206735=40, srv472904609=65, srv410371438=64, srv900986681=92, srv1622028358=27, srv875224405=88, srv1099543702=2, srv309527636=56, srv1170079455=4, srv2013254505=43, srv303111367=55, srv555761733=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:54:01,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:54:01,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-22 01:54:01,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-22 01:54:01,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-22 01:54:01,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-22 01:54:01,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-22 01:54:01,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-22 01:54:01,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-22 01:54:01,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-22 01:54:01,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:01,591 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1065173053:83 , srv1099543702:83 , srv1175488138:83 , srv1303333050:83 , srv1705807490:83 , srv190206735:83 , srv473668015:83 , srv78570305:83 , srv855673524:83 , srv875224405:83 , srv1170079455:84 , srv1202112182:84 , srv120736107:84 , srv1269895053:84 , srv1282682248:84 , srv1283107115:84 , srv1301658865:84 , srv1325897226:84 , srv1350450235:84 , srv1365284747:84 , srv1373524564:84 , srv141585110:84 , srv1428166291:84 , srv1473722057:84 , srv1481418656:84 , srv1522581602:84 , srv1543324729:84 , srv1567576326:84 , srv1576220278:84 , srv1622028358:84 , srv1632752210:84 , srv1633007057:84 , srv1640067847:84 , srv1680247277:84 , srv1700416480:84 , srv1700759837:84 , srv1758588324:84 , srv1771228791:84 , srv1855113220:84 , srv1892855456:84 , srv1915818079:84 , srv1980801262:84 , srv2013254505:84 , srv2050973400:84 , srv2064398896:84 , srv2071571514:84 , srv2122224205:84 , srv244723560:84 , srv257100412:84 , srv258382127:84 , srv2613557:84 , srv298041041:84 , srv303111367:84 , srv309527636:84 , srv361140071:84 , srv361324361:84 , srv366047481:84 , srv371355011:84 , srv376731216:84 , srv382076777:84 , srv410371438:84 , srv472904609:84 , srv514690535:84 , srv52566042:84 , srv531569710:84 , srv537147664:84 , srv556732401:84 , srv619807474:84 , srv625246617:84 , srv674532774:84 , srv689363571:84 , srv75195552:84 , srv758487556:84 , srv799678326:84 , srv811679107:84 , srv825714369:84 , srv827274824:84 , srv83607675:84 , srv875445219:84 , srv876091482:84 , srv900715781:84 , srv900986681:84 , srv902656355:84 , srv912340046:84 , srv925073122:84 , srv951278115:84 , srv978808511:84 , srv980784745:84 , srv986203341:84 , srv1067134017:85 , srv1157698480:85 , srv137182702:85 , srv1820157500:85 , srv2054581699:85 , srv254005938:85 , srv394928088:85 , srv555761733:85 , srv73027594:85 , srv829458074:85 , srv1315257796:684 }
2023-02-22 01:54:01,621 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=283 (was 264) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=7689 (was 8201)
2023-02-22 01:54:01,630 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=172, AvailableMemoryMB=7688
2023-02-22 01:54:01,631 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-22 01:54:01,632 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-22 01:54:01,641 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1150202565:84 , srv1258230229:84 , srv1298736962:84 , srv1350279642:84 , srv1441841089:84 , srv1504781296:84 , srv1557621480:84 , srv15761109:84 , srv162596094:84 , srv1782518728:84 , srv1863704829:84 , srv1867857427:84 , srv1927750310:84 , srv1934391632:84 , srv2019511138:84 , srv380317606:84 , srv404526611:84 , srv429831861:84 , srv566131698:84 , srv602868034:84 , srv654794522:84 , srv675483941:84 , srv729945718:84 , srv741360284:84 , srv778764812:84 , srv859651044:84 , srv863729853:84 , srv885992424:84 , srv959667259:84 , srv1945120005:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-22 01:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1298736962=2, srv1258230229=1, srv1350279642=3, srv675483941=22, srv654794522=21, srv15761109=7, srv1867857427=11, srv1945120005=14, srv959667259=29, srv1150202565=0, srv2019511138=15, srv429831861=18, srv778764812=25, srv1441841089=4, srv1927750310=12, srv1504781296=5, srv885992424=28, srv729945718=23, srv1863704829=10, srv1782518728=9, srv859651044=26, srv1934391632=13, srv741360284=24, srv404526611=17, srv162596094=8, srv380317606=16, srv602868034=20, srv1557621480=6, srv566131698=19, srv863729853=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:54:01,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:54:01,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:54:01,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:54:01,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:54:01,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:54:01,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:54:01,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:54:01,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:54:01,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:54:01,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-22 01:54:01,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2072617277619737, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:54:01,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912846118200738, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2072617277619737, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-22 01:56:01,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6179794 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912846118200738 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:56:01,667 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1150202565:90 , srv1258230229:90 , srv1298736962:90 , srv1350279642:90 , srv1441841089:90 , srv1504781296:90 , srv1557621480:90 , srv15761109:90 , srv162596094:90 , srv1782518728:90 , srv1863704829:90 , srv1867857427:90 , srv1927750310:90 , srv1934391632:90 , srv1945120005:90 , srv2019511138:90 , srv380317606:90 , srv404526611:90 , srv429831861:90 , srv566131698:90 , srv602868034:90 , srv654794522:90 , srv675483941:90 , srv729945718:90 , srv741360284:90 , srv778764812:90 , srv859651044:90 , srv863729853:90 , srv885992424:90 , srv959667259:90 }
2023-02-22 01:56:01,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-22 01:56:01,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1298736962=2, srv1258230229=1, srv1350279642=3, srv675483941=22, srv654794522=21, srv15761109=7, srv1867857427=11, srv1945120005=14, srv959667259=29, srv1150202565=0, srv2019511138=15, srv429831861=18, srv778764812=25, srv1441841089=4, srv1927750310=12, srv1504781296=5, srv885992424=28, srv729945718=23, srv1863704829=10, srv1782518728=9, srv859651044=26, srv1934391632=13, srv741360284=24, srv404526611=17, srv162596094=8, srv380317606=16, srv602868034=20, srv1557621480=6, srv566131698=19, srv863729853=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-22 01:56:01,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-22 01:56:01,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-22 01:56:01,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-22 01:56:01,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-22 01:56:01,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-22 01:56:01,686 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1150202565:90 , srv1258230229:90 , srv1298736962:90 , srv1350279642:90 , srv1441841089:90 , srv1504781296:90 , srv1557621480:90 , srv15761109:90 , srv162596094:90 , srv1782518728:90 , srv1863704829:90 , srv1867857427:90 , srv1927750310:90 , srv1934391632:90 , srv1945120005:90 , srv2019511138:90 , srv380317606:90 , srv404526611:90 , srv429831861:90 , srv566131698:90 , srv602868034:90 , srv654794522:90 , srv675483941:90 , srv729945718:90 , srv741360284:90 , srv778764812:90 , srv859651044:90 , srv863729853:90 , srv885992424:90 , srv959667259:90 }
2023-02-22 01:56:01,699 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 283), ProcessCount=172 (was 172), AvailableMemoryMB=7504 (was 7688)