2023-08-11 01:53:10,827 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-11 01:53:11,151 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-11 01:53:11,272 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-11 01:53:11,348 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-11 01:53:11,355 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-11 01:53:11,369 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=173, AvailableMemoryMB=6153
2023-08-11 01:53:11,372 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-11 01:53:11,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-11 01:53:11,517 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012912938:84 , srv1071064339:84 , srv1109192325:84 , srv1110328754:84 , srv1142544439:84 , srv1163427915:84 , srv1184206516:84 , srv1188970482:84 , srv1210838311:84 , srv1212659708:84 , srv1222741843:84 , srv1243625759:84 , srv1267784369:84 , srv127785523:84 , srv1289210584:84 , srv130709820:84 , srv1329720763:84 , srv1350903412:84 , srv1364516265:84 , srv1364638823:84 , srv1367793597:84 , srv1369570600:84 , srv1371242273:84 , srv1373769301:84 , srv1443275551:84 , srv145104813:84 , srv1453936460:84 , srv1502649011:84 , srv1515663501:84 , srv1573283345:84 , srv1599624774:84 , srv1634646211:84 , srv1642983930:84 , srv1694205350:84 , srv1697171906:84 , srv1710241950:84 , srv1724082967:84 , srv1740534480:84 , srv1743768516:84 , srv1749620072:84 , srv1770633596:84 , srv1779968266:84 , srv1830610893:84 , srv1831034392:84 , srv1848532919:84 , srv1849097936:84 , srv188354981:84 , srv1894264096:84 , srv1906122427:84 , srv19161831:84 , srv1924547247:84 , srv1925259677:84 , srv1931173065:84 , srv1963288961:84 , srv2032843348:84 , srv2050948006:84 , srv2081010605:84 , srv2086656648:84 , srv208728126:84 , srv2094981926:84 , srv2105148942:84 , srv269286641:84 , srv312322148:84 , srv344135098:84 , srv363362650:84 , srv369519991:84 , srv388151441:84 , srv398322030:84 , srv417435750:84 , srv428839485:84 , srv47672681:84 , srv509372008:84 , srv530311885:84 , srv589236514:84 , srv624550153:84 , srv63184288:84 , srv633636821:84 , srv656147749:84 , srv665171400:84 , srv667013492:84 , srv68229789:84 , srv704329674:84 , srv739333163:84 , srv753806568:84 , srv756221459:84 , srv798102548:84 , srv841475361:84 , srv841815192:84 , srv85411632:84 , srv858296808:84 , srv86822894:84 , srv891801525:84 , srv91015715:84 , srv917477590:84 , srv934556158:84 , srv946912206:84 , srv96593844:84 , srv966020469:84 , srv97610033:84 , srv495848451:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-11 01:53:11,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:11,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv269286641=61, srv1830610893=42, srv1573283345=29, srv753806568=84, srv1634646211=31, srv1924547247=50, srv1770633596=40, srv1373769301=23, srv85411632=89, srv68229789=81, srv966020469=98, srv1367793597=20, srv1163427915=5, srv2081010605=56, srv1184206516=6, srv589236514=74, srv91015715=93, srv1642983930=32, srv1364516265=18, srv739333163=83, srv1110328754=3, srv1925259677=51, srv667013492=80, srv363362650=64, srv312322148=62, srv1350903412=17, srv369519991=65, srv1222741843=10, srv208728126=58, srv86822894=91, srv1906122427=48, srv1369570600=21, srv1931173065=52, srv917477590=94, srv1071064339=1, srv891801525=92, srv1743768516=38, srv1243625759=11, srv1364638823=19, srv495848451=71, srv1453936460=26, srv398322030=67, srv1289210584=14, srv145104813=25, srv1697171906=34, srv388151441=66, srv428839485=69, srv1210838311=8, srv633636821=77, srv1779968266=41, srv1740534480=37, srv19161831=49, srv1963288961=53, srv2032843348=54, srv1212659708=9, srv130709820=15, srv858296808=90, srv946912206=96, srv1724082967=36, srv1749620072=39, srv841475361=87, srv344135098=63, srv1894264096=47, srv798102548=86, srv704329674=82, srv841815192=88, srv1831034392=43, srv1515663501=28, srv97610033=99, srv656147749=78, srv1329720763=16, srv2094981926=59, srv63184288=76, srv756221459=85, srv96593844=97, srv47672681=70, srv1109192325=2, srv934556158=95, srv1599624774=30, srv2105148942=60, srv1371242273=22, srv509372008=72, srv1012912938=0, srv417435750=68, srv1710241950=35, srv1267784369=12, srv127785523=13, srv665171400=79, srv1848532919=44, srv1694205350=33, srv1188970482=7, srv1502649011=27, srv2050948006=55, srv188354981=46, srv530311885=73, srv2086656648=57, srv1142544439=4, srv1443275551=24, srv1849097936=45, srv624550153=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:11,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:11,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 01:53:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 01:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 01:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 01:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 01:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 01:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 01:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 01:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 01:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 01:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 01:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 01:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 01:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 01:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 01:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 01:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 01:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 01:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 01:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 01:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 01:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 01:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 01:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 01:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 01:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 01:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 01:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 01:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 01:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 01:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 01:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 01:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 01:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 01:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 01:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 01:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 01:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 01:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 01:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 01:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 01:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 01:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 01:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 01:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 01:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 01:53:11,864 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:11,865 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 01:53:11,865 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 01:53:12,263 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 615 ms to try 5000 different iterations.  Found a solution that moves 4680 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18221220195003937. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03928910624536775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05985016832649107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.52, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03928910624536775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17783333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24016666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:12,275 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv428839485:80 , srv891801525:81 , srv1212659708:82 , srv1373769301:82 , srv1710241950:82 , srv2032843348:82 , srv2050948006:82 , srv798102548:82 , srv96593844:82 , srv1289210584:83 , srv1369570600:83 , srv1894264096:83 , srv2086656648:83 , srv85411632:83 , srv91015715:83 , srv1163427915:84 , srv1364516265:84 , srv1367793597:84 , srv1371242273:84 , srv1849097936:84 , srv208728126:84 , srv68229789:84 , srv858296808:84 , srv86822894:84 , srv917477590:84 , srv946912206:84 , srv1071064339:85 , srv1222741843:85 , srv127785523:85 , srv1443275551:85 , srv312322148:85 , srv388151441:85 , srv417435750:85 , srv47672681:85 , srv63184288:85 , srv966020469:85 , srv1110328754:86 , srv1142544439:86 , srv1184206516:86 , srv1453936460:86 , srv1724082967:86 , srv19161831:86 , srv1924547247:86 , srv1931173065:86 , srv2081010605:86 , srv633636821:86 , srv756221459:86 , srv1267784369:87 , srv1329720763:87 , srv1364638823:87 , srv145104813:87 , srv1599624774:87 , srv1697171906:87 , srv1743768516:87 , srv1749620072:87 , srv1779968266:87 , srv1830610893:87 , srv1848532919:87 , srv1963288961:87 , srv2094981926:87 , srv269286641:87 , srv369519991:87 , srv753806568:87 , srv841475361:87 , srv1012912938:88 , srv1109192325:88 , srv1188970482:88 , srv1243625759:88 , srv130709820:88 , srv1515663501:88 , srv1642983930:88 , srv363362650:88 , srv667013492:88 , srv934556158:88 , srv1350903412:89 , srv1634646211:89 , srv1740534480:89 , srv1770633596:89 , srv1831034392:89 , srv1925259677:89 , srv344135098:89 , srv509372008:89 , srv589236514:89 , srv624550153:89 , srv665171400:89 , srv841815192:89 , srv97610033:89 , srv1210838311:90 , srv188354981:90 , srv1906122427:90 , srv656147749:90 , srv704329674:90 , srv739333163:90 , srv1502649011:91 , srv398322030:91 , srv530311885:91 , srv1573283345:92 , srv1694205350:93 , srv2105148942:94 , srv495848451:439 }
2023-08-11 01:53:12,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:12,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv269286641=61, srv1830610893=42, srv1573283345=29, srv753806568=84, srv1634646211=31, srv1924547247=50, srv1770633596=40, srv1373769301=23, srv85411632=89, srv68229789=81, srv966020469=98, srv1367793597=20, srv1163427915=5, srv2081010605=56, srv1184206516=6, srv589236514=74, srv91015715=93, srv1642983930=32, srv1364516265=18, srv739333163=83, srv1110328754=3, srv1925259677=51, srv667013492=80, srv363362650=64, srv312322148=62, srv1350903412=17, srv369519991=65, srv1222741843=10, srv208728126=58, srv86822894=91, srv1906122427=48, srv1369570600=21, srv1931173065=52, srv917477590=94, srv1071064339=1, srv891801525=92, srv1743768516=38, srv1243625759=11, srv1364638823=19, srv495848451=71, srv1453936460=26, srv398322030=67, srv1289210584=14, srv145104813=25, srv1697171906=34, srv388151441=66, srv428839485=69, srv1210838311=8, srv633636821=77, srv1779968266=41, srv1740534480=37, srv19161831=49, srv1963288961=53, srv2032843348=54, srv1212659708=9, srv130709820=15, srv858296808=90, srv946912206=96, srv1724082967=36, srv1749620072=39, srv841475361=87, srv344135098=63, srv1894264096=47, srv798102548=86, srv704329674=82, srv841815192=88, srv1831034392=43, srv1515663501=28, srv97610033=99, srv656147749=78, srv1329720763=16, srv2094981926=59, srv63184288=76, srv756221459=85, srv96593844=97, srv47672681=70, srv1109192325=2, srv934556158=95, srv1599624774=30, srv2105148942=60, srv1371242273=22, srv509372008=72, srv1012912938=0, srv417435750=68, srv1710241950=35, srv1267784369=12, srv127785523=13, srv665171400=79, srv1848532919=44, srv1694205350=33, srv1188970482=7, srv1502649011=27, srv2050948006=55, srv188354981=46, srv530311885=73, srv2086656648=57, srv1142544439=4, srv1443275551=24, srv1849097936=45, srv624550153=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 01:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 01:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 01:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 01:53:12,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 01:53:12,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 01:53:12,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03928910624536775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05985016832649107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03928910624536775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17783333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24016666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:12,419 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 01:53:12,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1821794318896308, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03928910624536775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05985016832649107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03928910624536775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17783333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24016666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 01:53:12,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 438 ms to try 5000 different iterations.  Found a solution that moves 2623 regions; Going from a computed imbalance of 0.1821794318896308 to a new imbalance of 0.015442530533850274. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021837294700360728); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03817380066536547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29144444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021837294700360728); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:12,758 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2105148942:77 , srv1573283345:79 , srv1694205350:79 , srv1634646211:81 , srv1740534480:81 , srv398322030:81 , srv624550153:81 , srv1012912938:82 , srv1188970482:82 , srv1210838311:82 , srv1502649011:82 , srv1515663501:82 , srv188354981:82 , srv1906122427:82 , srv665171400:82 , srv704329674:82 , srv739333163:82 , srv130709820:83 , srv145104813:83 , srv1697171906:83 , srv1925259677:83 , srv841475361:83 , srv841815192:83 , srv1243625759:84 , srv1329720763:84 , srv1350903412:84 , srv1770633596:84 , srv1779968266:84 , srv1831034392:84 , srv1931173065:84 , srv2081010605:84 , srv269286641:84 , srv344135098:84 , srv369519991:84 , srv530311885:84 , srv589236514:84 , srv1109192325:85 , srv1364638823:85 , srv1642983930:85 , srv1848532919:85 , srv363362650:85 , srv509372008:85 , srv656147749:85 , srv667013492:85 , srv753806568:85 , srv97610033:85 , srv1071064339:86 , srv1110328754:86 , srv1267784369:86 , srv1364516265:86 , srv1443275551:86 , srv1599624774:86 , srv1749620072:86 , srv19161831:86 , srv1963288961:86 , srv756221459:86 , srv85411632:86 , srv946912206:86 , srv1142544439:87 , srv1222741843:87 , srv127785523:87 , srv1367793597:87 , srv1724082967:87 , srv1924547247:87 , srv2094981926:87 , srv63184288:87 , srv633636821:87 , srv68229789:87 , srv858296808:87 , srv917477590:87 , srv934556158:87 , srv96593844:87 , srv966020469:87 , srv1369570600:88 , srv1373769301:88 , srv1453936460:88 , srv1830610893:88 , srv1849097936:88 , srv1894264096:88 , srv2086656648:88 , srv388151441:88 , srv417435750:88 , srv47672681:88 , srv1163427915:89 , srv1212659708:89 , srv1710241950:89 , srv1743768516:89 , srv2050948006:89 , srv312322148:89 , srv798102548:89 , srv86822894:89 , srv91015715:89 , srv1184206516:90 , srv1371242273:90 , srv208728126:90 , srv891801525:90 , srv1289210584:91 , srv428839485:91 , srv2032843348:92 , srv495848451:529 }
2023-08-11 01:53:12,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv269286641=61, srv1830610893=42, srv1573283345=29, srv753806568=84, srv1634646211=31, srv1924547247=50, srv1770633596=40, srv1373769301=23, srv85411632=89, srv68229789=81, srv966020469=98, srv1367793597=20, srv1163427915=5, srv2081010605=56, srv1184206516=6, srv589236514=74, srv91015715=93, srv1642983930=32, srv1364516265=18, srv739333163=83, srv1110328754=3, srv1925259677=51, srv667013492=80, srv363362650=64, srv312322148=62, srv1350903412=17, srv369519991=65, srv1222741843=10, srv208728126=58, srv86822894=91, srv1906122427=48, srv1369570600=21, srv1931173065=52, srv917477590=94, srv1071064339=1, srv891801525=92, srv1743768516=38, srv1243625759=11, srv1364638823=19, srv495848451=71, srv1453936460=26, srv398322030=67, srv1289210584=14, srv145104813=25, srv1697171906=34, srv388151441=66, srv428839485=69, srv1210838311=8, srv633636821=77, srv1779968266=41, srv1740534480=37, srv19161831=49, srv1963288961=53, srv2032843348=54, srv1212659708=9, srv130709820=15, srv858296808=90, srv946912206=96, srv1724082967=36, srv1749620072=39, srv841475361=87, srv344135098=63, srv1894264096=47, srv798102548=86, srv704329674=82, srv841815192=88, srv1831034392=43, srv1515663501=28, srv97610033=99, srv656147749=78, srv1329720763=16, srv2094981926=59, srv63184288=76, srv756221459=85, srv96593844=97, srv47672681=70, srv1109192325=2, srv934556158=95, srv1599624774=30, srv2105148942=60, srv1371242273=22, srv509372008=72, srv1012912938=0, srv417435750=68, srv1710241950=35, srv1267784369=12, srv127785523=13, srv665171400=79, srv1848532919=44, srv1694205350=33, srv1188970482=7, srv1502649011=27, srv2050948006=55, srv188354981=46, srv530311885=73, srv2086656648=57, srv1142544439=4, srv1443275551=24, srv1849097936=45, srv624550153=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 01:53:12,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 01:53:12,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 01:53:12,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 01:53:12,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 01:53:12,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 01:53:12,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 01:53:12,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 01:53:12,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 01:53:12,940 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021837294700360728); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03817380066536547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021837294700360728); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:12,941 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 01:53:12,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015424163895292234, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021837294700360728); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03817380066536547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021837294700360728); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 01:53:13,284 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 457 ms to try 5000 different iterations.  Found a solution that moves 995 regions; Going from a computed imbalance of 0.015424163895292234 to a new imbalance of 8.625924659269058E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007338059219328525); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010562198866399846); MoveCostFunction : (multiplier=7.0, imbalance=0.11055555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007338059219328525); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:13,287 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1184206516:82 , srv1743768516:82 , srv1830610893:82 , srv1289210584:83 , srv1371242273:83 , srv1453936460:83 , srv2032843348:83 , srv208728126:83 , srv2094981926:83 , srv656147749:83 , srv934556158:83 , srv1142544439:84 , srv1163427915:84 , srv1222741843:84 , srv1267784369:84 , srv1599624774:84 , srv1724082967:84 , srv1749620072:84 , srv1770633596:84 , srv1831034392:84 , srv188354981:84 , srv1924547247:84 , srv312322148:84 , srv363362650:84 , srv388151441:84 , srv509372008:84 , srv530311885:84 , srv589236514:84 , srv667013492:84 , srv753806568:84 , srv86822894:84 , srv97610033:84 , srv1109192325:85 , srv1110328754:85 , srv1243625759:85 , srv1350903412:85 , srv1364638823:85 , srv1502649011:85 , srv1642983930:85 , srv1694205350:85 , srv1710241950:85 , srv1848532919:85 , srv1894264096:85 , srv19161831:85 , srv1925259677:85 , srv1963288961:85 , srv344135098:85 , srv398322030:85 , srv417435750:85 , srv428839485:85 , srv47672681:85 , srv633636821:85 , srv704329674:85 , srv739333163:85 , srv841815192:85 , srv91015715:85 , srv1210838311:86 , srv127785523:86 , srv1364516265:86 , srv1369570600:86 , srv1373769301:86 , srv1443275551:86 , srv1515663501:86 , srv1849097936:86 , srv2050948006:86 , srv2086656648:86 , srv2105148942:86 , srv269286641:86 , srv665171400:86 , srv891801525:86 , srv966020469:86 , srv1012912938:87 , srv1071064339:87 , srv1188970482:87 , srv1212659708:87 , srv130709820:87 , srv1329720763:87 , srv1367793597:87 , srv1573283345:87 , srv1634646211:87 , srv1697171906:87 , srv1740534480:87 , srv1779968266:87 , srv1906122427:87 , srv1931173065:87 , srv2081010605:87 , srv369519991:87 , srv624550153:87 , srv63184288:87 , srv68229789:87 , srv756221459:87 , srv798102548:87 , srv841475361:87 , srv858296808:87 , srv917477590:87 , srv946912206:87 , srv145104813:88 , srv96593844:88 , srv85411632:90 , srv495848451:555 }
2023-08-11 01:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:13,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv269286641=61, srv1830610893=42, srv1573283345=29, srv753806568=84, srv1634646211=31, srv1924547247=50, srv1770633596=40, srv1373769301=23, srv85411632=89, srv68229789=81, srv966020469=98, srv1367793597=20, srv1163427915=5, srv2081010605=56, srv1184206516=6, srv589236514=74, srv91015715=93, srv1642983930=32, srv1364516265=18, srv739333163=83, srv1110328754=3, srv1925259677=51, srv667013492=80, srv363362650=64, srv312322148=62, srv1350903412=17, srv369519991=65, srv1222741843=10, srv208728126=58, srv86822894=91, srv1906122427=48, srv1369570600=21, srv1931173065=52, srv917477590=94, srv1071064339=1, srv891801525=92, srv1743768516=38, srv1243625759=11, srv1364638823=19, srv495848451=71, srv1453936460=26, srv398322030=67, srv1289210584=14, srv145104813=25, srv1697171906=34, srv388151441=66, srv428839485=69, srv1210838311=8, srv633636821=77, srv1779968266=41, srv1740534480=37, srv19161831=49, srv1963288961=53, srv2032843348=54, srv1212659708=9, srv130709820=15, srv858296808=90, srv946912206=96, srv1724082967=36, srv1749620072=39, srv841475361=87, srv344135098=63, srv1894264096=47, srv798102548=86, srv704329674=82, srv841815192=88, srv1831034392=43, srv1515663501=28, srv97610033=99, srv656147749=78, srv1329720763=16, srv2094981926=59, srv63184288=76, srv756221459=85, srv96593844=97, srv47672681=70, srv1109192325=2, srv934556158=95, srv1599624774=30, srv2105148942=60, srv1371242273=22, srv509372008=72, srv1012912938=0, srv417435750=68, srv1710241950=35, srv1267784369=12, srv127785523=13, srv665171400=79, srv1848532919=44, srv1694205350=33, srv1188970482=7, srv1502649011=27, srv2050948006=55, srv188354981=46, srv530311885=73, srv2086656648=57, srv1142544439=4, srv1443275551=24, srv1849097936=45, srv624550153=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 01:53:13,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 01:53:13,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 01:53:13,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 01:53:13,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 01:53:13,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 01:53:13,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 01:53:13,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 01:53:13,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 01:53:13,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007338059219328525); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010562198866399846); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007338059219328525); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:13,471 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 01:53:13,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.556253270152599E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007338059219328525); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010562198866399846); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007338059219328525); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 01:53:13,897 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 561 ms to try 5000 different iterations.  Found a solution that moves 307 regions; Going from a computed imbalance of 8.556253270152599E-4 to a new imbalance of 3.857652239568852E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0025070047769678496); MoveCostFunction : (multiplier=7.0, imbalance=0.03411111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:13,898 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1906122427:83 , srv63184288:83 , srv85411632:83 , srv934556158:83 , srv1109192325:84 , srv1184206516:84 , srv1210838311:84 , srv1212659708:84 , srv1243625759:84 , srv127785523:84 , srv130709820:84 , srv1329720763:84 , srv1367793597:84 , srv145104813:84 , srv1453936460:84 , srv1502649011:84 , srv1573283345:84 , srv1634646211:84 , srv1642983930:84 , srv1743768516:84 , srv1779968266:84 , srv1849097936:84 , srv1925259677:84 , srv1963288961:84 , srv312322148:84 , srv344135098:84 , srv369519991:84 , srv398322030:84 , srv417435750:84 , srv47672681:84 , srv509372008:84 , srv530311885:84 , srv656147749:84 , srv68229789:84 , srv739333163:84 , srv756221459:84 , srv798102548:84 , srv841475361:84 , srv858296808:84 , srv86822894:84 , srv917477590:84 , srv966020469:84 , srv97610033:84 , srv1071064339:85 , srv1110328754:85 , srv1142544439:85 , srv1163427915:85 , srv1188970482:85 , srv1267784369:85 , srv1289210584:85 , srv1350903412:85 , srv1364638823:85 , srv1371242273:85 , srv1373769301:85 , srv1443275551:85 , srv1599624774:85 , srv1694205350:85 , srv1697171906:85 , srv1710241950:85 , srv1724082967:85 , srv1740534480:85 , srv1749620072:85 , srv1770633596:85 , srv1831034392:85 , srv1848532919:85 , srv1894264096:85 , srv19161831:85 , srv1924547247:85 , srv1931173065:85 , srv2032843348:85 , srv2050948006:85 , srv2081010605:85 , srv2086656648:85 , srv208728126:85 , srv2094981926:85 , srv2105148942:85 , srv363362650:85 , srv388151441:85 , srv589236514:85 , srv624550153:85 , srv633636821:85 , srv665171400:85 , srv667013492:85 , srv704329674:85 , srv891801525:85 , srv91015715:85 , srv946912206:85 , srv96593844:85 , srv1012912938:86 , srv1222741843:86 , srv1369570600:86 , srv1515663501:86 , srv1830610893:86 , srv269286641:86 , srv428839485:86 , srv753806568:86 , srv841815192:86 , srv1364516265:87 , srv188354981:87 , srv495848451:619 }
2023-08-11 01:53:13,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:13,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv269286641=61, srv1830610893=42, srv1573283345=29, srv753806568=84, srv1634646211=31, srv1924547247=50, srv1770633596=40, srv1373769301=23, srv85411632=89, srv68229789=81, srv966020469=98, srv1367793597=20, srv1163427915=5, srv2081010605=56, srv1184206516=6, srv589236514=74, srv91015715=93, srv1642983930=32, srv1364516265=18, srv739333163=83, srv1110328754=3, srv1925259677=51, srv667013492=80, srv363362650=64, srv312322148=62, srv1350903412=17, srv369519991=65, srv1222741843=10, srv208728126=58, srv86822894=91, srv1906122427=48, srv1369570600=21, srv1931173065=52, srv917477590=94, srv1071064339=1, srv891801525=92, srv1743768516=38, srv1243625759=11, srv1364638823=19, srv495848451=71, srv1453936460=26, srv398322030=67, srv1289210584=14, srv145104813=25, srv1697171906=34, srv388151441=66, srv428839485=69, srv1210838311=8, srv633636821=77, srv1779968266=41, srv1740534480=37, srv19161831=49, srv1963288961=53, srv2032843348=54, srv1212659708=9, srv130709820=15, srv858296808=90, srv946912206=96, srv1724082967=36, srv1749620072=39, srv841475361=87, srv344135098=63, srv1894264096=47, srv798102548=86, srv704329674=82, srv841815192=88, srv1831034392=43, srv1515663501=28, srv97610033=99, srv656147749=78, srv1329720763=16, srv2094981926=59, srv63184288=76, srv756221459=85, srv96593844=97, srv47672681=70, srv1109192325=2, srv934556158=95, srv1599624774=30, srv2105148942=60, srv1371242273=22, srv509372008=72, srv1012912938=0, srv417435750=68, srv1710241950=35, srv1267784369=12, srv127785523=13, srv665171400=79, srv1848532919=44, srv1694205350=33, srv1188970482=7, srv1502649011=27, srv2050948006=55, srv188354981=46, srv530311885=73, srv2086656648=57, srv1142544439=4, srv1443275551=24, srv1849097936=45, srv624550153=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:13,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:13,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:13,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:13,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:13,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:13,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 01:53:13,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 01:53:13,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 01:53:13,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 01:53:13,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 01:53:13,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 01:53:13,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 01:53:13,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 01:53:13,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 01:53:14,058 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0025070047769678496); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:14,059 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 01:53:14,059 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.642686245008522E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0025070047769678496); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 01:53:14,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 405 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 3.642686245008522E-5 to a new imbalance of 9.045267627076837E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:14,349 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1012912938:83 , srv1071064339:83 , srv1350903412:83 , srv1364516265:83 , srv1369570600:83 , srv1830610893:83 , srv188354981:83 , srv269286641:83 , srv530311885:83 , srv633636821:83 , srv756221459:83 , srv841815192:83 , srv1109192325:84 , srv1110328754:84 , srv1142544439:84 , srv1163427915:84 , srv1184206516:84 , srv1188970482:84 , srv1210838311:84 , srv1212659708:84 , srv1222741843:84 , srv1267784369:84 , srv127785523:84 , srv1289210584:84 , srv130709820:84 , srv1329720763:84 , srv1364638823:84 , srv1367793597:84 , srv1371242273:84 , srv1443275551:84 , srv145104813:84 , srv1502649011:84 , srv1515663501:84 , srv1573283345:84 , srv1599624774:84 , srv1642983930:84 , srv1694205350:84 , srv1697171906:84 , srv1724082967:84 , srv1740534480:84 , srv1743768516:84 , srv1749620072:84 , srv1770633596:84 , srv1779968266:84 , srv1831034392:84 , srv1848532919:84 , srv1849097936:84 , srv1906122427:84 , srv19161831:84 , srv1924547247:84 , srv1931173065:84 , srv1963288961:84 , srv2032843348:84 , srv2050948006:84 , srv2081010605:84 , srv2086656648:84 , srv208728126:84 , srv2094981926:84 , srv2105148942:84 , srv312322148:84 , srv344135098:84 , srv363362650:84 , srv369519991:84 , srv388151441:84 , srv417435750:84 , srv428839485:84 , srv47672681:84 , srv509372008:84 , srv589236514:84 , srv624550153:84 , srv63184288:84 , srv656147749:84 , srv665171400:84 , srv667013492:84 , srv68229789:84 , srv704329674:84 , srv753806568:84 , srv798102548:84 , srv85411632:84 , srv858296808:84 , srv891801525:84 , srv91015715:84 , srv917477590:84 , srv946912206:84 , srv96593844:84 , srv966020469:84 , srv97610033:84 , srv1243625759:85 , srv1373769301:85 , srv1453936460:85 , srv1634646211:85 , srv1710241950:85 , srv1894264096:85 , srv1925259677:85 , srv398322030:85 , srv739333163:85 , srv841475361:85 , srv86822894:85 , srv934556158:85 , srv495848451:684 }
2023-08-11 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv269286641=61, srv1830610893=42, srv1573283345=29, srv753806568=84, srv1634646211=31, srv1924547247=50, srv1770633596=40, srv1373769301=23, srv85411632=89, srv68229789=81, srv966020469=98, srv1367793597=20, srv1163427915=5, srv2081010605=56, srv1184206516=6, srv589236514=74, srv91015715=93, srv1642983930=32, srv1364516265=18, srv739333163=83, srv1110328754=3, srv1925259677=51, srv667013492=80, srv363362650=64, srv312322148=62, srv1350903412=17, srv369519991=65, srv1222741843=10, srv208728126=58, srv86822894=91, srv1906122427=48, srv1369570600=21, srv1931173065=52, srv917477590=94, srv1071064339=1, srv891801525=92, srv1743768516=38, srv1243625759=11, srv1364638823=19, srv495848451=71, srv1453936460=26, srv398322030=67, srv1289210584=14, srv145104813=25, srv1697171906=34, srv388151441=66, srv428839485=69, srv1210838311=8, srv633636821=77, srv1779968266=41, srv1740534480=37, srv19161831=49, srv1963288961=53, srv2032843348=54, srv1212659708=9, srv130709820=15, srv858296808=90, srv946912206=96, srv1724082967=36, srv1749620072=39, srv841475361=87, srv344135098=63, srv1894264096=47, srv798102548=86, srv704329674=82, srv841815192=88, srv1831034392=43, srv1515663501=28, srv97610033=99, srv656147749=78, srv1329720763=16, srv2094981926=59, srv63184288=76, srv756221459=85, srv96593844=97, srv47672681=70, srv1109192325=2, srv934556158=95, srv1599624774=30, srv2105148942=60, srv1371242273=22, srv509372008=72, srv1012912938=0, srv417435750=68, srv1710241950=35, srv1267784369=12, srv127785523=13, srv665171400=79, srv1848532919=44, srv1694205350=33, srv1188970482=7, srv1502649011=27, srv2050948006=55, srv188354981=46, srv530311885=73, srv2086656648=57, srv1142544439=4, srv1443275551=24, srv1849097936=45, srv624550153=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:14,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 01:53:14,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 01:53:14,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 01:53:14,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 01:53:14,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 01:53:14,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 01:53:14,529 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.793190239318795E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:14,529 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1012912938:83 , srv1071064339:83 , srv1350903412:83 , srv1364516265:83 , srv1369570600:83 , srv1830610893:83 , srv188354981:83 , srv269286641:83 , srv530311885:83 , srv633636821:83 , srv756221459:83 , srv841815192:83 , srv1109192325:84 , srv1110328754:84 , srv1142544439:84 , srv1163427915:84 , srv1184206516:84 , srv1188970482:84 , srv1210838311:84 , srv1212659708:84 , srv1222741843:84 , srv1267784369:84 , srv127785523:84 , srv1289210584:84 , srv130709820:84 , srv1329720763:84 , srv1364638823:84 , srv1367793597:84 , srv1371242273:84 , srv1443275551:84 , srv145104813:84 , srv1502649011:84 , srv1515663501:84 , srv1573283345:84 , srv1599624774:84 , srv1642983930:84 , srv1694205350:84 , srv1697171906:84 , srv1724082967:84 , srv1740534480:84 , srv1743768516:84 , srv1749620072:84 , srv1770633596:84 , srv1779968266:84 , srv1831034392:84 , srv1848532919:84 , srv1849097936:84 , srv1906122427:84 , srv19161831:84 , srv1924547247:84 , srv1931173065:84 , srv1963288961:84 , srv2032843348:84 , srv2050948006:84 , srv2081010605:84 , srv2086656648:84 , srv208728126:84 , srv2094981926:84 , srv2105148942:84 , srv312322148:84 , srv344135098:84 , srv363362650:84 , srv369519991:84 , srv388151441:84 , srv417435750:84 , srv428839485:84 , srv47672681:84 , srv509372008:84 , srv589236514:84 , srv624550153:84 , srv63184288:84 , srv656147749:84 , srv665171400:84 , srv667013492:84 , srv68229789:84 , srv704329674:84 , srv753806568:84 , srv798102548:84 , srv85411632:84 , srv858296808:84 , srv891801525:84 , srv91015715:84 , srv917477590:84 , srv946912206:84 , srv96593844:84 , srv966020469:84 , srv97610033:84 , srv1243625759:85 , srv1373769301:85 , srv1453936460:85 , srv1634646211:85 , srv1710241950:85 , srv1894264096:85 , srv1925259677:85 , srv398322030:85 , srv739333163:85 , srv841475361:85 , srv86822894:85 , srv934556158:85 , srv495848451:684 }
2023-08-11 01:53:14,559 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 310), ProcessCount=173 (was 173), AvailableMemoryMB=5309 (was 6153)
2023-08-11 01:53:14,570 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=173, AvailableMemoryMB=5308
2023-08-11 01:53:14,571 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-11 01:53:14,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-11 01:53:14,584 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1115178393:84 , srv1159620557:84 , srv1203844660:84 , srv1267373943:84 , srv1408146179:84 , srv1441260112:84 , srv1445757527:84 , srv1500491717:84 , srv1551026323:84 , srv1591228063:84 , srv1677082853:84 , srv1698660701:84 , srv1890922071:84 , srv1951755545:84 , srv195891132:84 , srv19713568:84 , srv2110787283:84 , srv218930787:84 , srv247408741:84 , srv25109622:84 , srv260075695:84 , srv266589387:84 , srv278083608:84 , srv334866719:84 , srv427563984:84 , srv557796501:84 , srv611176802:84 , srv915764936:84 , srv946082180:84 , srv1162689604:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-11 01:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445757527=7, srv1951755545=14, srv334866719=24, srv1267373943=4, srv25109622=20, srv1591228063=10, srv1698660701=12, srv260075695=21, srv1500491717=8, srv195891132=15, srv266589387=22, srv247408741=19, srv218930787=18, srv278083608=23, srv1162689604=2, srv19713568=16, srv1408146179=5, srv1677082853=11, srv915764936=28, srv2110787283=17, srv557796501=26, srv1890922071=13, srv1159620557=1, srv1115178393=0, srv1203844660=3, srv1441260112=6, srv1551026323=9, srv427563984=25, srv946082180=29, srv611176802=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:53:14,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:53:14,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:53:14,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:53:14,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-11 01:53:14,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0302663525012927, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:53:14,631 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912288411552727, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0302663525012927, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-11 01:55:14,607 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5926899 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912288411552727 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:55:14,615 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1115178393:90 , srv1159620557:90 , srv1162689604:90 , srv1203844660:90 , srv1267373943:90 , srv1408146179:90 , srv1441260112:90 , srv1445757527:90 , srv1500491717:90 , srv1551026323:90 , srv1591228063:90 , srv1677082853:90 , srv1698660701:90 , srv1890922071:90 , srv1951755545:90 , srv195891132:90 , srv19713568:90 , srv2110787283:90 , srv218930787:90 , srv247408741:90 , srv25109622:90 , srv260075695:90 , srv266589387:90 , srv278083608:90 , srv334866719:90 , srv427563984:90 , srv557796501:90 , srv611176802:90 , srv915764936:90 , srv946082180:90 }
2023-08-11 01:55:14,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 01:55:14,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1445757527=7, srv1951755545=14, srv334866719=24, srv1267373943=4, srv25109622=20, srv1591228063=10, srv1698660701=12, srv260075695=21, srv1500491717=8, srv195891132=15, srv266589387=22, srv247408741=19, srv218930787=18, srv278083608=23, srv1162689604=2, srv19713568=16, srv1408146179=5, srv1677082853=11, srv915764936=28, srv2110787283=17, srv557796501=26, srv1890922071=13, srv1159620557=1, srv1115178393=0, srv1203844660=3, srv1441260112=6, srv1551026323=9, srv427563984=25, srv946082180=29, srv611176802=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 01:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 01:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 01:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 01:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 01:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 01:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-11 01:55:14,637 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 01:55:14,637 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1115178393:90 , srv1159620557:90 , srv1162689604:90 , srv1203844660:90 , srv1267373943:90 , srv1408146179:90 , srv1441260112:90 , srv1445757527:90 , srv1500491717:90 , srv1551026323:90 , srv1591228063:90 , srv1677082853:90 , srv1698660701:90 , srv1890922071:90 , srv1951755545:90 , srv195891132:90 , srv19713568:90 , srv2110787283:90 , srv218930787:90 , srv247408741:90 , srv25109622:90 , srv260075695:90 , srv266589387:90 , srv278083608:90 , srv334866719:90 , srv427563984:90 , srv557796501:90 , srv611176802:90 , srv915764936:90 , srv946082180:90 }
2023-08-11 01:55:14,649 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 310), ProcessCount=171 (was 173), AvailableMemoryMB=5069 (was 5308)