2023-02-24 07:53:58,651 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-24 07:53:58,955 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-24 07:53:59,074 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-24 07:53:59,141 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-24 07:53:59,149 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-24 07:53:59,165 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=173, AvailableMemoryMB=6484
2023-02-24 07:53:59,168 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-24 07:53:59,168 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-24 07:53:59,334 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1071972841:84 , srv1166654770:84 , srv11741412:84 , srv1179386262:84 , srv1221288137:84 , srv1224515874:84 , srv1265590824:84 , srv1316254368:84 , srv1322661807:84 , srv1335380539:84 , srv1356663120:84 , srv1380890483:84 , srv1395132941:84 , srv1407643519:84 , srv1431205822:84 , srv1441254623:84 , srv1457175672:84 , srv1469321463:84 , srv1501574313:84 , srv1524206955:84 , srv1529535915:84 , srv1532684911:84 , srv1540919564:84 , srv1544238990:84 , srv1564876266:84 , srv1582321113:84 , srv1608957259:84 , srv1628851078:84 , srv1644711083:84 , srv1662052555:84 , srv1682388348:84 , srv1706729246:84 , srv1738610676:84 , srv174831720:84 , srv1751471572:84 , srv1795344276:84 , srv1795942215:84 , srv184307431:84 , srv1877404278:84 , srv1878717099:84 , srv1929090645:84 , srv1935365037:84 , srv1967959454:84 , srv1996973452:84 , srv2017611652:84 , srv2034766300:84 , srv2071359964:84 , srv2100358177:84 , srv2101855725:84 , srv2112332912:84 , srv248969935:84 , srv266204021:84 , srv266431420:84 , srv272425312:84 , srv285933450:84 , srv290533372:84 , srv403743221:84 , srv411831252:84 , srv439292945:84 , srv441306882:84 , srv449530895:84 , srv449987578:84 , srv456059386:84 , srv459386982:84 , srv463797935:84 , srv467822376:84 , srv493742982:84 , srv501310030:84 , srv504769484:84 , srv515894963:84 , srv602393509:84 , srv608547691:84 , srv618145841:84 , srv620123282:84 , srv630378256:84 , srv649949150:84 , srv668307599:84 , srv673351843:84 , srv673970922:84 , srv709139472:84 , srv734253128:84 , srv736168718:84 , srv747960715:84 , srv765731588:84 , srv787896694:84 , srv803416092:84 , srv807621106:84 , srv818064739:84 , srv821063245:84 , srv826649551:84 , srv87376452:84 , srv893988754:84 , srv918074157:84 , srv955315631:84 , srv963640980:84 , srv964366460:84 , srv98373957:84 , srv991010061:84 , srv999429563:84 , srv643403961:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-24 07:53:59,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:53:59,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2071359964=46, srv955315631=94, srv1071972841=0, srv441306882=59, srv11741412=2, srv2112332912=49, srv1316254368=7, srv1644711083=28, srv1628851078=27, srv449530895=60, srv649949150=76, srv449987578=61, srv1564876266=24, srv463797935=64, srv736168718=82, srv1877404278=38, srv999429563=99, srv803416092=86, srv964366460=96, srv1469321463=17, srv630378256=74, srv2101855725=48, srv1544238990=23, srv668307599=77, srv87376452=91, srv1935365037=41, srv266204021=51, srv1166654770=1, srv2100358177=47, srv411831252=57, srv1682388348=30, srv1706729246=31, srv821063245=89, srv467822376=65, srv1582321113=25, srv290533372=55, srv504769484=68, srv403743221=56, srv1795942215=36, srv1751471572=34, srv918074157=93, srv1540919564=22, srv1996973452=43, srv98373957=97, srv1532684911=21, srv1441254623=15, srv1265590824=6, srv1501574313=18, srv1356663120=10, srv1179386262=3, srv673351843=78, srv643403961=75, srv1335380539=9, srv1608957259=26, srv1662052555=29, srv765731588=84, srv787896694=85, srv184307431=37, srv734253128=81, srv602393509=70, srv1524206955=19, srv608547691=71, srv1380890483=11, srv456059386=62, srv1967959454=42, srv620123282=73, srv493742982=66, srv174831720=33, srv673970922=79, srv963640980=95, srv272425312=53, srv1224515874=5, srv439292945=58, srv826649551=90, srv1407643519=13, srv1431205822=14, srv818064739=88, srv747960715=83, srv893988754=92, srv2017611652=44, srv991010061=98, srv1795344276=35, srv501310030=67, srv285933450=54, srv1878717099=39, srv459386982=63, srv1221288137=4, srv2034766300=45, srv807621106=87, srv1738610676=32, srv248969935=50, srv618145841=72, srv709139472=80, srv266431420=52, srv1457175672=16, srv1395132941=12, srv1529535915=20, srv1929090645=40, srv1322661807=8, srv515894963=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:53:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:53:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:53:59,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:53:59,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:53:59,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:53:59,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:53:59,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:53:59,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:53:59,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:53:59,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:53:59,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:53:59,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:53:59,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:53:59,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:53:59,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:53:59,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:53:59,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:53:59,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-24 07:53:59,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-24 07:53:59,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-24 07:53:59,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-24 07:53:59,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-24 07:53:59,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-24 07:53:59,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-24 07:53:59,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-24 07:53:59,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-24 07:53:59,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-24 07:53:59,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-24 07:53:59,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-24 07:53:59,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-24 07:53:59,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-24 07:53:59,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-24 07:53:59,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-24 07:53:59,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-24 07:53:59,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-24 07:53:59,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-24 07:53:59,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-24 07:53:59,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-24 07:53:59,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-24 07:53:59,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-24 07:53:59,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-24 07:53:59,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-24 07:53:59,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-24 07:53:59,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-24 07:53:59,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-24 07:53:59,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-24 07:53:59,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-24 07:53:59,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-24 07:53:59,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-24 07:53:59,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-24 07:53:59,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-24 07:53:59,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-24 07:53:59,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-24 07:53:59,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-24 07:53:59,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-24 07:53:59,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-24 07:53:59,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:53:59,673 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-24 07:53:59,673 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-24 07:54:00,442 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 938 ms to try 5000 different iterations.  Found a solution that moves 4699 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17663605550553865. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04144508985695445, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0537504730749416, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5221111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04144508985695445, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:00,477 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1644711083:81 , srv174831720:81 , srv493742982:81 , srv1457175672:82 , srv1540919564:82 , srv1967959454:82 , srv821063245:82 , srv893988754:82 , srv1166654770:83 , srv1356663120:83 , srv1395132941:83 , srv184307431:83 , srv2034766300:83 , srv272425312:83 , srv403743221:83 , srv467822376:83 , srv618145841:83 , srv630378256:83 , srv747960715:83 , srv1608957259:84 , srv1935365037:84 , srv266431420:84 , srv285933450:84 , srv290533372:84 , srv441306882:84 , srv456059386:84 , srv765731588:84 , srv1221288137:85 , srv1322661807:85 , srv1335380539:85 , srv1431205822:85 , srv1628851078:85 , srv1738610676:85 , srv1751471572:85 , srv1996973452:85 , srv2101855725:85 , srv2112332912:85 , srv459386982:85 , srv515894963:85 , srv668307599:85 , srv734253128:85 , srv736168718:85 , srv803416092:85 , srv918074157:85 , srv11741412:86 , srv1407643519:86 , srv1662052555:86 , srv1877404278:86 , srv2017611652:86 , srv248969935:86 , srv504769484:86 , srv620123282:86 , srv673351843:86 , srv787896694:86 , srv807621106:86 , srv87376452:86 , srv955315631:86 , srv98373957:86 , srv1179386262:87 , srv1441254623:87 , srv1564876266:87 , srv1682388348:87 , srv1878717099:87 , srv2071359964:87 , srv2100358177:87 , srv709139472:87 , srv826649551:87 , srv963640980:87 , srv964366460:87 , srv991010061:87 , srv1265590824:88 , srv1380890483:88 , srv1469321463:88 , srv1544238990:88 , srv1929090645:88 , srv266204021:88 , srv411831252:88 , srv463797935:88 , srv501310030:88 , srv1224515874:89 , srv1501574313:89 , srv1524206955:89 , srv1532684911:89 , srv1706729246:89 , srv1795344276:89 , srv439292945:89 , srv608547691:89 , srv1795942215:90 , srv673970922:90 , srv818064739:90 , srv999429563:90 , srv1071972841:91 , srv602393509:91 , srv1529535915:92 , srv1316254368:93 , srv1582321113:94 , srv449987578:94 , srv649949150:94 , srv449530895:98 , srv643403961:458 }
2023-02-24 07:54:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:54:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2071359964=46, srv955315631=94, srv1071972841=0, srv441306882=59, srv11741412=2, srv2112332912=49, srv1316254368=7, srv1644711083=28, srv1628851078=27, srv449530895=60, srv649949150=76, srv449987578=61, srv1564876266=24, srv463797935=64, srv736168718=82, srv1877404278=38, srv999429563=99, srv803416092=86, srv964366460=96, srv1469321463=17, srv630378256=74, srv2101855725=48, srv1544238990=23, srv668307599=77, srv87376452=91, srv1935365037=41, srv266204021=51, srv1166654770=1, srv2100358177=47, srv411831252=57, srv1682388348=30, srv1706729246=31, srv821063245=89, srv467822376=65, srv1582321113=25, srv290533372=55, srv504769484=68, srv403743221=56, srv1795942215=36, srv1751471572=34, srv918074157=93, srv1540919564=22, srv1996973452=43, srv98373957=97, srv1532684911=21, srv1441254623=15, srv1265590824=6, srv1501574313=18, srv1356663120=10, srv1179386262=3, srv673351843=78, srv643403961=75, srv1335380539=9, srv1608957259=26, srv1662052555=29, srv765731588=84, srv787896694=85, srv184307431=37, srv734253128=81, srv602393509=70, srv1524206955=19, srv608547691=71, srv1380890483=11, srv456059386=62, srv1967959454=42, srv620123282=73, srv493742982=66, srv174831720=33, srv673970922=79, srv963640980=95, srv272425312=53, srv1224515874=5, srv439292945=58, srv826649551=90, srv1407643519=13, srv1431205822=14, srv818064739=88, srv747960715=83, srv893988754=92, srv2017611652=44, srv991010061=98, srv1795344276=35, srv501310030=67, srv285933450=54, srv1878717099=39, srv459386982=63, srv1221288137=4, srv2034766300=45, srv807621106=87, srv1738610676=32, srv248969935=50, srv618145841=72, srv709139472=80, srv266431420=52, srv1457175672=16, srv1395132941=12, srv1529535915=20, srv1929090645=40, srv1322661807=8, srv515894963=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:54:00,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:54:00,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:54:00,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:54:00,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:54:00,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-24 07:54:00,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-24 07:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-24 07:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-24 07:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-24 07:54:00,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-24 07:54:00,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-24 07:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-24 07:54:00,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-24 07:54:00,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-24 07:54:00,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-24 07:54:00,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-24 07:54:00,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-24 07:54:00,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-24 07:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-24 07:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-24 07:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-24 07:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-24 07:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-24 07:54:00,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-24 07:54:00,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-24 07:54:00,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-24 07:54:00,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-24 07:54:00,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-24 07:54:00,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-24 07:54:00,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-24 07:54:00,729 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04144508985695445, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0537504730749416, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04144508985695445, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:00,729 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-24 07:54:00,730 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1766031524042866, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04144508985695445, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0537504730749416, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04144508985695445, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-24 07:54:01,121 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 551 ms to try 5000 different iterations.  Found a solution that moves 2648 regions; Going from a computed imbalance of 0.1766031524042866 to a new imbalance of 0.01537149589510081. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021603623496951375); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029270977494043313, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2942222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021603623496951375); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:01,132 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv449530895:76 , srv1582321113:77 , srv1316254368:78 , srv1529535915:78 , srv649949150:79 , srv449987578:80 , srv1532684911:81 , srv1071972841:82 , srv1224515874:82 , srv1380890483:82 , srv1501574313:82 , srv1795942215:82 , srv1878717099:82 , srv439292945:82 , srv1469321463:83 , srv1706729246:83 , srv1929090645:83 , srv2100358177:83 , srv266204021:83 , srv501310030:83 , srv602393509:83 , srv673970922:83 , srv818064739:83 , srv991010061:83 , srv1179386262:84 , srv1524206955:84 , srv1544238990:84 , srv1564876266:84 , srv463797935:84 , srv608547691:84 , srv620123282:84 , srv709139472:84 , srv807621106:84 , srv999429563:84 , srv1221288137:85 , srv1265590824:85 , srv1407643519:85 , srv1441254623:85 , srv1738610676:85 , srv1795344276:85 , srv1877404278:85 , srv411831252:85 , srv787896694:85 , srv963640980:85 , srv11741412:86 , srv1322661807:86 , srv1335380539:86 , srv1662052555:86 , srv2017611652:86 , srv2071359964:86 , srv2101855725:86 , srv2112332912:86 , srv248969935:86 , srv290533372:86 , srv459386982:86 , srv504769484:86 , srv515894963:86 , srv673351843:86 , srv918074157:86 , srv964366460:86 , srv98373957:86 , srv1395132941:87 , srv1628851078:87 , srv1682388348:87 , srv266431420:87 , srv734253128:87 , srv826649551:87 , srv1608957259:88 , srv184307431:88 , srv2034766300:88 , srv285933450:88 , srv441306882:88 , srv456059386:88 , srv618145841:88 , srv668307599:88 , srv87376452:88 , srv1166654770:89 , srv1431205822:89 , srv1751471572:89 , srv1967959454:89 , srv1996973452:89 , srv630378256:89 , srv736168718:89 , srv747960715:89 , srv803416092:89 , srv1356663120:90 , srv1935365037:90 , srv272425312:90 , srv403743221:90 , srv765731588:90 , srv955315631:90 , srv1540919564:91 , srv1644711083:91 , srv467822376:91 , srv493742982:91 , srv821063245:91 , srv893988754:91 , srv1457175672:92 , srv174831720:94 , srv643403961:508 }
2023-02-24 07:54:01,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:54:01,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2071359964=46, srv955315631=94, srv1071972841=0, srv441306882=59, srv11741412=2, srv2112332912=49, srv1316254368=7, srv1644711083=28, srv1628851078=27, srv449530895=60, srv649949150=76, srv449987578=61, srv1564876266=24, srv463797935=64, srv736168718=82, srv1877404278=38, srv999429563=99, srv803416092=86, srv964366460=96, srv1469321463=17, srv630378256=74, srv2101855725=48, srv1544238990=23, srv668307599=77, srv87376452=91, srv1935365037=41, srv266204021=51, srv1166654770=1, srv2100358177=47, srv411831252=57, srv1682388348=30, srv1706729246=31, srv821063245=89, srv467822376=65, srv1582321113=25, srv290533372=55, srv504769484=68, srv403743221=56, srv1795942215=36, srv1751471572=34, srv918074157=93, srv1540919564=22, srv1996973452=43, srv98373957=97, srv1532684911=21, srv1441254623=15, srv1265590824=6, srv1501574313=18, srv1356663120=10, srv1179386262=3, srv673351843=78, srv643403961=75, srv1335380539=9, srv1608957259=26, srv1662052555=29, srv765731588=84, srv787896694=85, srv184307431=37, srv734253128=81, srv602393509=70, srv1524206955=19, srv608547691=71, srv1380890483=11, srv456059386=62, srv1967959454=42, srv620123282=73, srv493742982=66, srv174831720=33, srv673970922=79, srv963640980=95, srv272425312=53, srv1224515874=5, srv439292945=58, srv826649551=90, srv1407643519=13, srv1431205822=14, srv818064739=88, srv747960715=83, srv893988754=92, srv2017611652=44, srv991010061=98, srv1795344276=35, srv501310030=67, srv285933450=54, srv1878717099=39, srv459386982=63, srv1221288137=4, srv2034766300=45, srv807621106=87, srv1738610676=32, srv248969935=50, srv618145841=72, srv709139472=80, srv266431420=52, srv1457175672=16, srv1395132941=12, srv1529535915=20, srv1929090645=40, srv1322661807=8, srv515894963=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:54:01,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:54:01,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:54:01,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:54:01,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:54:01,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:54:01,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:54:01,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:54:01,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-24 07:54:01,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-24 07:54:01,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-24 07:54:01,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-24 07:54:01,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-24 07:54:01,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-24 07:54:01,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-24 07:54:01,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-24 07:54:01,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-24 07:54:01,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-24 07:54:01,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-24 07:54:01,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021603623496951375); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029270977494043313, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021603623496951375); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:01,320 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-24 07:54:01,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015352954202801274, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021603623496951375); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029270977494043313, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021603623496951375); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-24 07:54:01,592 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 411 ms to try 5000 different iterations.  Found a solution that moves 998 regions; Going from a computed imbalance of 0.015352954202801274 to a new imbalance of 6.063925803942631E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006646058683306059); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006048810069325199); MoveCostFunction : (multiplier=7.0, imbalance=0.11088888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006646058683306059); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:01,595 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv955315631:81 , srv174831720:82 , srv1431205822:83 , srv1457175672:83 , srv1795344276:83 , srv1935365037:83 , srv1996973452:83 , srv449987578:83 , srv467822376:83 , srv736168718:83 , srv803416092:83 , srv87376452:83 , srv1356663120:84 , srv1524206955:84 , srv1682388348:84 , srv1751471572:84 , srv272425312:84 , srv403743221:84 , srv411831252:84 , srv449530895:84 , srv602393509:84 , srv608547691:84 , srv673970922:84 , srv765731588:84 , srv821063245:84 , srv826649551:84 , srv893988754:84 , srv999429563:84 , srv1071972841:85 , srv1265590824:85 , srv1441254623:85 , srv1540919564:85 , srv1628851078:85 , srv1662052555:85 , srv1706729246:85 , srv2017611652:85 , srv2071359964:85 , srv248969935:85 , srv285933450:85 , srv441306882:85 , srv493742982:85 , srv630378256:85 , srv649949150:85 , srv668307599:85 , srv673351843:85 , srv734253128:85 , srv747960715:85 , srv963640980:85 , srv964366460:85 , srv98373957:85 , srv1166654770:86 , srv11741412:86 , srv1179386262:86 , srv1316254368:86 , srv1322661807:86 , srv1501574313:86 , srv1544238990:86 , srv1608957259:86 , srv1644711083:86 , srv1795942215:86 , srv184307431:86 , srv1877404278:86 , srv1967959454:86 , srv2101855725:86 , srv266204021:86 , srv266431420:86 , srv456059386:86 , srv459386982:86 , srv463797935:86 , srv501310030:86 , srv504769484:86 , srv515894963:86 , srv787896694:86 , srv818064739:86 , srv918074157:86 , srv1224515874:87 , srv1335380539:87 , srv1380890483:87 , srv1395132941:87 , srv1407643519:87 , srv1469321463:87 , srv1532684911:87 , srv1564876266:87 , srv1582321113:87 , srv1738610676:87 , srv1929090645:87 , srv2034766300:87 , srv2112332912:87 , srv290533372:87 , srv439292945:87 , srv618145841:87 , srv620123282:87 , srv709139472:87 , srv807621106:87 , srv991010061:87 , srv1221288137:88 , srv1529535915:88 , srv1878717099:88 , srv2100358177:88 , srv643403961:551 }
2023-02-24 07:54:01,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:54:01,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2071359964=46, srv955315631=94, srv1071972841=0, srv441306882=59, srv11741412=2, srv2112332912=49, srv1316254368=7, srv1644711083=28, srv1628851078=27, srv449530895=60, srv649949150=76, srv449987578=61, srv1564876266=24, srv463797935=64, srv736168718=82, srv1877404278=38, srv999429563=99, srv803416092=86, srv964366460=96, srv1469321463=17, srv630378256=74, srv2101855725=48, srv1544238990=23, srv668307599=77, srv87376452=91, srv1935365037=41, srv266204021=51, srv1166654770=1, srv2100358177=47, srv411831252=57, srv1682388348=30, srv1706729246=31, srv821063245=89, srv467822376=65, srv1582321113=25, srv290533372=55, srv504769484=68, srv403743221=56, srv1795942215=36, srv1751471572=34, srv918074157=93, srv1540919564=22, srv1996973452=43, srv98373957=97, srv1532684911=21, srv1441254623=15, srv1265590824=6, srv1501574313=18, srv1356663120=10, srv1179386262=3, srv673351843=78, srv643403961=75, srv1335380539=9, srv1608957259=26, srv1662052555=29, srv765731588=84, srv787896694=85, srv184307431=37, srv734253128=81, srv602393509=70, srv1524206955=19, srv608547691=71, srv1380890483=11, srv456059386=62, srv1967959454=42, srv620123282=73, srv493742982=66, srv174831720=33, srv673970922=79, srv963640980=95, srv272425312=53, srv1224515874=5, srv439292945=58, srv826649551=90, srv1407643519=13, srv1431205822=14, srv818064739=88, srv747960715=83, srv893988754=92, srv2017611652=44, srv991010061=98, srv1795344276=35, srv501310030=67, srv285933450=54, srv1878717099=39, srv459386982=63, srv1221288137=4, srv2034766300=45, srv807621106=87, srv1738610676=32, srv248969935=50, srv618145841=72, srv709139472=80, srv266431420=52, srv1457175672=16, srv1395132941=12, srv1529535915=20, srv1929090645=40, srv1322661807=8, srv515894963=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:54:01,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:54:01,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-24 07:54:01,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-24 07:54:01,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-24 07:54:01,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-24 07:54:01,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-24 07:54:01,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-24 07:54:01,782 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006646058683306059); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006048810069325199); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006646058683306059); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:01,783 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-24 07:54:01,783 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.994044350336374E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006646058683306059); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006048810069325199); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006646058683306059); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-24 07:54:02,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 393 ms to try 5000 different iterations.  Found a solution that moves 221 regions; Going from a computed imbalance of 5.994044350336374E-4 to a new imbalance of 2.7357760896027103E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.024555555555555556); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:02,046 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1544238990:83 , srv2100358177:83 , srv818064739:83 , srv1071972841:84 , srv11741412:84 , srv1179386262:84 , srv1221288137:84 , srv1224515874:84 , srv1265590824:84 , srv1335380539:84 , srv1407643519:84 , srv1469321463:84 , srv1529535915:84 , srv1532684911:84 , srv1540919564:84 , srv1564876266:84 , srv1582321113:84 , srv1608957259:84 , srv1644711083:84 , srv1682388348:84 , srv1751471572:84 , srv1795942215:84 , srv1929090645:84 , srv2034766300:84 , srv2071359964:84 , srv2112332912:84 , srv439292945:84 , srv456059386:84 , srv459386982:84 , srv463797935:84 , srv501310030:84 , srv504769484:84 , srv618145841:84 , srv649949150:84 , srv668307599:84 , srv709139472:84 , srv747960715:84 , srv765731588:84 , srv826649551:84 , srv964366460:84 , srv999429563:84 , srv1166654770:85 , srv1316254368:85 , srv1356663120:85 , srv1380890483:85 , srv1395132941:85 , srv1431205822:85 , srv1441254623:85 , srv1457175672:85 , srv1501574313:85 , srv1524206955:85 , srv1628851078:85 , srv1706729246:85 , srv1738610676:85 , srv174831720:85 , srv1795344276:85 , srv184307431:85 , srv1877404278:85 , srv1878717099:85 , srv1935365037:85 , srv1967959454:85 , srv1996973452:85 , srv2017611652:85 , srv248969935:85 , srv266204021:85 , srv266431420:85 , srv272425312:85 , srv285933450:85 , srv290533372:85 , srv403743221:85 , srv411831252:85 , srv441306882:85 , srv449530895:85 , srv449987578:85 , srv467822376:85 , srv493742982:85 , srv515894963:85 , srv602393509:85 , srv608547691:85 , srv620123282:85 , srv673351843:85 , srv673970922:85 , srv734253128:85 , srv736168718:85 , srv787896694:85 , srv803416092:85 , srv807621106:85 , srv821063245:85 , srv87376452:85 , srv893988754:85 , srv918074157:85 , srv955315631:85 , srv963640980:85 , srv98373957:85 , srv991010061:85 , srv1322661807:86 , srv1662052555:86 , srv2101855725:86 , srv630378256:86 , srv643403961:625 }
2023-02-24 07:54:02,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:54:02,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2071359964=46, srv955315631=94, srv1071972841=0, srv441306882=59, srv11741412=2, srv2112332912=49, srv1316254368=7, srv1644711083=28, srv1628851078=27, srv449530895=60, srv649949150=76, srv449987578=61, srv1564876266=24, srv463797935=64, srv736168718=82, srv1877404278=38, srv999429563=99, srv803416092=86, srv964366460=96, srv1469321463=17, srv630378256=74, srv2101855725=48, srv1544238990=23, srv668307599=77, srv87376452=91, srv1935365037=41, srv266204021=51, srv1166654770=1, srv2100358177=47, srv411831252=57, srv1682388348=30, srv1706729246=31, srv821063245=89, srv467822376=65, srv1582321113=25, srv290533372=55, srv504769484=68, srv403743221=56, srv1795942215=36, srv1751471572=34, srv918074157=93, srv1540919564=22, srv1996973452=43, srv98373957=97, srv1532684911=21, srv1441254623=15, srv1265590824=6, srv1501574313=18, srv1356663120=10, srv1179386262=3, srv673351843=78, srv643403961=75, srv1335380539=9, srv1608957259=26, srv1662052555=29, srv765731588=84, srv787896694=85, srv184307431=37, srv734253128=81, srv602393509=70, srv1524206955=19, srv608547691=71, srv1380890483=11, srv456059386=62, srv1967959454=42, srv620123282=73, srv493742982=66, srv174831720=33, srv673970922=79, srv963640980=95, srv272425312=53, srv1224515874=5, srv439292945=58, srv826649551=90, srv1407643519=13, srv1431205822=14, srv818064739=88, srv747960715=83, srv893988754=92, srv2017611652=44, srv991010061=98, srv1795344276=35, srv501310030=67, srv285933450=54, srv1878717099=39, srv459386982=63, srv1221288137=4, srv2034766300=45, srv807621106=87, srv1738610676=32, srv248969935=50, srv618145841=72, srv709139472=80, srv266431420=52, srv1457175672=16, srv1395132941=12, srv1529535915=20, srv1929090645=40, srv1322661807=8, srv515894963=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:54:02,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:54:02,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:54:02,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:54:02,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:54:02,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:54:02,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:54:02,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-24 07:54:02,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-24 07:54:02,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-24 07:54:02,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-24 07:54:02,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-24 07:54:02,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:02,171 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-24 07:54:02,171 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.581028582117912E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-24 07:54:02,388 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 314 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 2.581028582117912E-5 to a new imbalance of 6.93312709465048E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:02,388 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1166654770:83 , srv1322661807:83 , srv1662052555:83 , srv2101855725:83 , srv449530895:83 , srv602393509:83 , srv630378256:83 , srv1071972841:84 , srv11741412:84 , srv1221288137:84 , srv1224515874:84 , srv1265590824:84 , srv1316254368:84 , srv1335380539:84 , srv1356663120:84 , srv1380890483:84 , srv1395132941:84 , srv1407643519:84 , srv1431205822:84 , srv1441254623:84 , srv1457175672:84 , srv1469321463:84 , srv1501574313:84 , srv1524206955:84 , srv1529535915:84 , srv1540919564:84 , srv1564876266:84 , srv1582321113:84 , srv1608957259:84 , srv1628851078:84 , srv1644711083:84 , srv1682388348:84 , srv1706729246:84 , srv1738610676:84 , srv174831720:84 , srv1751471572:84 , srv1795344276:84 , srv1795942215:84 , srv184307431:84 , srv1877404278:84 , srv1878717099:84 , srv1929090645:84 , srv1935365037:84 , srv1967959454:84 , srv1996973452:84 , srv2017611652:84 , srv2034766300:84 , srv2071359964:84 , srv2112332912:84 , srv248969935:84 , srv266204021:84 , srv266431420:84 , srv272425312:84 , srv285933450:84 , srv290533372:84 , srv403743221:84 , srv411831252:84 , srv439292945:84 , srv441306882:84 , srv449987578:84 , srv456059386:84 , srv463797935:84 , srv467822376:84 , srv493742982:84 , srv504769484:84 , srv515894963:84 , srv608547691:84 , srv618145841:84 , srv620123282:84 , srv649949150:84 , srv668307599:84 , srv673351843:84 , srv673970922:84 , srv709139472:84 , srv734253128:84 , srv736168718:84 , srv765731588:84 , srv787896694:84 , srv803416092:84 , srv807621106:84 , srv818064739:84 , srv821063245:84 , srv826649551:84 , srv87376452:84 , srv893988754:84 , srv918074157:84 , srv955315631:84 , srv963640980:84 , srv964366460:84 , srv98373957:84 , srv991010061:84 , srv999429563:84 , srv1179386262:85 , srv1532684911:85 , srv1544238990:85 , srv2100358177:85 , srv459386982:85 , srv501310030:85 , srv747960715:85 , srv643403961:684 }
2023-02-24 07:54:02,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:54:02,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2071359964=46, srv955315631=94, srv1071972841=0, srv441306882=59, srv11741412=2, srv2112332912=49, srv1316254368=7, srv1644711083=28, srv1628851078=27, srv449530895=60, srv649949150=76, srv449987578=61, srv1564876266=24, srv463797935=64, srv736168718=82, srv1877404278=38, srv999429563=99, srv803416092=86, srv964366460=96, srv1469321463=17, srv630378256=74, srv2101855725=48, srv1544238990=23, srv668307599=77, srv87376452=91, srv1935365037=41, srv266204021=51, srv1166654770=1, srv2100358177=47, srv411831252=57, srv1682388348=30, srv1706729246=31, srv821063245=89, srv467822376=65, srv1582321113=25, srv290533372=55, srv504769484=68, srv403743221=56, srv1795942215=36, srv1751471572=34, srv918074157=93, srv1540919564=22, srv1996973452=43, srv98373957=97, srv1532684911=21, srv1441254623=15, srv1265590824=6, srv1501574313=18, srv1356663120=10, srv1179386262=3, srv673351843=78, srv643403961=75, srv1335380539=9, srv1608957259=26, srv1662052555=29, srv765731588=84, srv787896694=85, srv184307431=37, srv734253128=81, srv602393509=70, srv1524206955=19, srv608547691=71, srv1380890483=11, srv456059386=62, srv1967959454=42, srv620123282=73, srv493742982=66, srv174831720=33, srv673970922=79, srv963640980=95, srv272425312=53, srv1224515874=5, srv439292945=58, srv826649551=90, srv1407643519=13, srv1431205822=14, srv818064739=88, srv747960715=83, srv893988754=92, srv2017611652=44, srv991010061=98, srv1795344276=35, srv501310030=67, srv285933450=54, srv1878717099=39, srv459386982=63, srv1221288137=4, srv2034766300=45, srv807621106=87, srv1738610676=32, srv248969935=50, srv618145841=72, srv709139472=80, srv266431420=52, srv1457175672=16, srv1395132941=12, srv1529535915=20, srv1929090645=40, srv1322661807=8, srv515894963=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:54:02,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:54:02,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:54:02,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:54:02,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:54:02,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:54:02,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-24 07:54:02,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-24 07:54:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-24 07:54:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-24 07:54:02,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-24 07:54:02,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-24 07:54:02,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-24 07:54:02,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-24 07:54:02,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-24 07:54:02,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-24 07:54:02,530 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:02,530 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1166654770:83 , srv1322661807:83 , srv1662052555:83 , srv2101855725:83 , srv449530895:83 , srv602393509:83 , srv630378256:83 , srv1071972841:84 , srv11741412:84 , srv1221288137:84 , srv1224515874:84 , srv1265590824:84 , srv1316254368:84 , srv1335380539:84 , srv1356663120:84 , srv1380890483:84 , srv1395132941:84 , srv1407643519:84 , srv1431205822:84 , srv1441254623:84 , srv1457175672:84 , srv1469321463:84 , srv1501574313:84 , srv1524206955:84 , srv1529535915:84 , srv1540919564:84 , srv1564876266:84 , srv1582321113:84 , srv1608957259:84 , srv1628851078:84 , srv1644711083:84 , srv1682388348:84 , srv1706729246:84 , srv1738610676:84 , srv174831720:84 , srv1751471572:84 , srv1795344276:84 , srv1795942215:84 , srv184307431:84 , srv1877404278:84 , srv1878717099:84 , srv1929090645:84 , srv1935365037:84 , srv1967959454:84 , srv1996973452:84 , srv2017611652:84 , srv2034766300:84 , srv2071359964:84 , srv2112332912:84 , srv248969935:84 , srv266204021:84 , srv266431420:84 , srv272425312:84 , srv285933450:84 , srv290533372:84 , srv403743221:84 , srv411831252:84 , srv439292945:84 , srv441306882:84 , srv449987578:84 , srv456059386:84 , srv463797935:84 , srv467822376:84 , srv493742982:84 , srv504769484:84 , srv515894963:84 , srv608547691:84 , srv618145841:84 , srv620123282:84 , srv649949150:84 , srv668307599:84 , srv673351843:84 , srv673970922:84 , srv709139472:84 , srv734253128:84 , srv736168718:84 , srv765731588:84 , srv787896694:84 , srv803416092:84 , srv807621106:84 , srv818064739:84 , srv821063245:84 , srv826649551:84 , srv87376452:84 , srv893988754:84 , srv918074157:84 , srv955315631:84 , srv963640980:84 , srv964366460:84 , srv98373957:84 , srv991010061:84 , srv999429563:84 , srv1179386262:85 , srv1532684911:85 , srv1544238990:85 , srv2100358177:85 , srv459386982:85 , srv501310030:85 , srv747960715:85 , srv643403961:684 }
2023-02-24 07:54:02,553 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=449 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=5893 (was 6484)
2023-02-24 07:54:02,561 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=449, ProcessCount=173, AvailableMemoryMB=5893
2023-02-24 07:54:02,561 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-24 07:54:02,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-24 07:54:02,569 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1202779561:84 , srv1268620816:84 , srv1350456345:84 , srv1384953977:84 , srv1432252861:84 , srv1447777907:84 , srv1449403177:84 , srv1482908938:84 , srv158652093:84 , srv1757941622:84 , srv1793341602:84 , srv1843658614:84 , srv18995338:84 , srv1942394606:84 , srv1978755727:84 , srv1986915522:84 , srv2048092063:84 , srv2062768448:84 , srv237304404:84 , srv310378334:84 , srv381030026:84 , srv434287309:84 , srv495091270:84 , srv502740383:84 , srv504910953:84 , srv580925269:84 , srv824510218:84 , srv9402570:84 , srv973748698:84 , srv458093859:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-24 07:54:02,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:54:02,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1432252861=4, srv1482908938=7, srv9402570=28, srv1978755727=14, srv1757941622=9, srv504910953=25, srv1843658614=11, srv237304404=18, srv1449403177=6, srv458093859=22, srv824510218=27, srv1986915522=15, srv502740383=24, srv381030026=20, srv1793341602=10, srv1447777907=5, srv2062768448=17, srv1268620816=1, srv1384953977=3, srv495091270=23, srv1202779561=0, srv1350456345=2, srv158652093=8, srv1942394606=13, srv434287309=21, srv2048092063=16, srv18995338=12, srv973748698=29, srv310378334=19, srv580925269=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:54:02,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:54:02,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-24 07:54:02,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.109743446196208, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:54:02,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912538841279791, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.109743446196208, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-24 07:56:02,583 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6759784 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912538841279791 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:56:02,589 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1202779561:90 , srv1268620816:90 , srv1350456345:90 , srv1384953977:90 , srv1432252861:90 , srv1447777907:90 , srv1449403177:90 , srv1482908938:90 , srv158652093:90 , srv1757941622:90 , srv1793341602:90 , srv1843658614:90 , srv18995338:90 , srv1942394606:90 , srv1978755727:90 , srv1986915522:90 , srv2048092063:90 , srv2062768448:90 , srv237304404:90 , srv310378334:90 , srv381030026:90 , srv434287309:90 , srv458093859:90 , srv495091270:90 , srv502740383:90 , srv504910953:90 , srv580925269:90 , srv824510218:90 , srv9402570:90 , srv973748698:90 }
2023-02-24 07:56:02,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-24 07:56:02,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1432252861=4, srv1482908938=7, srv9402570=28, srv1978755727=14, srv1757941622=9, srv504910953=25, srv1843658614=11, srv237304404=18, srv1449403177=6, srv458093859=22, srv824510218=27, srv1986915522=15, srv502740383=24, srv381030026=20, srv1793341602=10, srv1447777907=5, srv2062768448=17, srv1268620816=1, srv1384953977=3, srv495091270=23, srv1202779561=0, srv1350456345=2, srv158652093=8, srv1942394606=13, srv434287309=21, srv2048092063=16, srv18995338=12, srv973748698=29, srv310378334=19, srv580925269=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-24 07:56:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-24 07:56:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-24 07:56:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-24 07:56:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-24 07:56:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-24 07:56:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-24 07:56:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-24 07:56:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-24 07:56:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-24 07:56:02,607 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-24 07:56:02,607 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1202779561:90 , srv1268620816:90 , srv1350456345:90 , srv1384953977:90 , srv1432252861:90 , srv1447777907:90 , srv1449403177:90 , srv1482908938:90 , srv158652093:90 , srv1757941622:90 , srv1793341602:90 , srv1843658614:90 , srv18995338:90 , srv1942394606:90 , srv1978755727:90 , srv1986915522:90 , srv2048092063:90 , srv2062768448:90 , srv237304404:90 , srv310378334:90 , srv381030026:90 , srv434287309:90 , srv458093859:90 , srv495091270:90 , srv502740383:90 , srv504910953:90 , srv580925269:90 , srv824510218:90 , srv9402570:90 , srv973748698:90 }
2023-02-24 07:56:02,621 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 449), ProcessCount=171 (was 173), AvailableMemoryMB=5884 (was 5893)