2023-12-06 21:53:14,050 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-06 21:53:14,367 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-06 21:53:14,479 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-06 21:53:14,548 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-06 21:53:14,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-06 21:53:14,573 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=264, ProcessCount=170, AvailableMemoryMB=12774
2023-12-06 21:53:14,575 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-06 21:53:14,575 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-06 21:53:14,694 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012020413:84 , srv1020141512:84 , srv104035352:84 , srv1047775158:84 , srv1052739187:84 , srv1067425655:84 , srv1075752559:84 , srv1103467920:84 , srv1110463102:84 , srv1128406079:84 , srv1129293560:84 , srv1136171757:84 , srv1136440160:84 , srv1145784021:84 , srv1211422302:84 , srv1219492337:84 , srv1243725299:84 , srv1246068596:84 , srv126127576:84 , srv1264545581:84 , srv1271869728:84 , srv134338630:84 , srv1355312574:84 , srv1393838504:84 , srv1396338476:84 , srv142835434:84 , srv148312997:84 , srv1516486150:84 , srv1517652583:84 , srv1527464926:84 , srv1534613442:84 , srv1560579870:84 , srv1584045550:84 , srv1642059281:84 , srv1672662149:84 , srv1691859216:84 , srv1820063398:84 , srv1876813096:84 , srv1930466739:84 , srv1937444726:84 , srv1938019029:84 , srv1979946790:84 , srv1993473431:84 , srv2010499780:84 , srv2016808863:84 , srv2064256381:84 , srv2068528637:84 , srv2073458139:84 , srv2095083460:84 , srv2099919191:84 , srv21005776:84 , srv2110271806:84 , srv2119407481:84 , srv2127779190:84 , srv252430128:84 , srv280343332:84 , srv325632230:84 , srv330243118:84 , srv367368881:84 , srv384696920:84 , srv428122526:84 , srv466266703:84 , srv478157295:84 , srv479737908:84 , srv486933559:84 , srv488390499:84 , srv530215599:84 , srv571738265:84 , srv575150247:84 , srv585005576:84 , srv597277206:84 , srv599777741:84 , srv607231136:84 , srv61225061:84 , srv621653328:84 , srv654140448:84 , srv65932461:84 , srv676464047:84 , srv686651531:84 , srv71213297:84 , srv730717106:84 , srv733087953:84 , srv737859285:84 , srv791032429:84 , srv793395359:84 , srv80221833:84 , srv80338384:84 , srv804005011:84 , srv819471182:84 , srv861165206:84 , srv876960301:84 , srv877493980:84 , srv892091443:84 , srv902513348:84 , srv903362055:84 , srv924692170:84 , srv955398644:84 , srv986914325:84 , srv992514782:84 , srv992138552:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-06 21:53:14,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:53:14,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1020141512=1, srv2068528637=46, srv1110463102=8, srv1876813096=37, srv902513348=93, srv2095083460=48, srv1067425655=5, srv2016808863=44, srv479737908=63, srv2110271806=51, srv142835434=25, srv861165206=89, srv597277206=70, srv384696920=59, srv730717106=80, srv2119407481=52, srv876960301=90, srv621653328=74, srv148312997=26, srv2010499780=43, srv986914325=97, srv1820063398=36, srv325632230=56, srv1246068596=17, srv1527464926=29, srv1642059281=33, srv1264545581=19, srv104035352=2, srv804005011=87, srv1691859216=35, srv1396338476=24, srv71213297=79, srv654140448=75, srv2127779190=53, srv892091443=92, srv1103467920=7, srv571738265=67, srv1136171757=11, srv486933559=64, srv21005776=50, srv478157295=62, srv65932461=76, srv80221833=85, srv955398644=96, srv330243118=57, srv599777741=71, srv1243725299=16, srv1211422302=14, srv1271869728=20, srv428122526=60, srv1979946790=41, srv466266703=61, srv733087953=81, srv676464047=77, srv1075752559=6, srv1129293560=10, srv793395359=84, srv1355312574=22, srv877493980=91, srv1393838504=23, srv924692170=95, srv126127576=18, srv992138552=98, srv686651531=78, srv1560579870=31, srv1938019029=40, srv1052739187=4, srv2064256381=45, srv992514782=99, srv367368881=58, srv819471182=88, srv1012020413=0, srv1047775158=3, srv1219492337=15, srv1145784021=13, srv737859285=82, srv903362055=94, srv1136440160=12, srv1672662149=34, srv2099919191=49, srv134338630=21, srv80338384=86, srv488390499=65, srv585005576=69, srv1930466739=38, srv1584045550=32, srv1516486150=27, srv1517652583=28, srv252430128=54, srv1128406079=9, srv61225061=73, srv1993473431=42, srv791032429=83, srv530215599=66, srv280343332=55, srv575150247=68, srv1937444726=39, srv1534613442=30, srv2073458139=47, srv607231136=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-06 21:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-06 21:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-06 21:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-06 21:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-06 21:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-06 21:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-06 21:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-06 21:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-06 21:53:15,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:15,044 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-06 21:53:15,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-06 21:53:15,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 591 ms to try 5000 different iterations.  Found a solution that moves 4715 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1739075296994857. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040151539856982985, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05729009410146646, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5238888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040151539856982985, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:15,456 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1047775158:82 , srv1517652583:82 , srv1075752559:83 , srv1243725299:83 , srv1271869728:83 , srv1584045550:83 , srv1876813096:83 , srv330243118:83 , srv479737908:83 , srv71213297:83 , srv733087953:83 , srv819471182:83 , srv903362055:83 , srv1012020413:84 , srv1219492337:84 , srv126127576:84 , srv148312997:84 , srv280343332:84 , srv530215599:84 , srv61225061:84 , srv793395359:84 , srv877493980:84 , srv1020141512:85 , srv1110463102:85 , srv1129293560:85 , srv1396338476:85 , srv1642059281:85 , srv1691859216:85 , srv1937444726:85 , srv1938019029:85 , srv1979946790:85 , srv466266703:85 , srv486933559:85 , srv571738265:85 , srv861165206:85 , srv992514782:85 , srv1128406079:86 , srv1145784021:86 , srv134338630:86 , srv1393838504:86 , srv1930466739:86 , srv2064256381:86 , srv2073458139:86 , srv2095083460:86 , srv2119407481:86 , srv252430128:86 , srv488390499:86 , srv597277206:86 , srv654140448:86 , srv80338384:86 , srv955398644:86 , srv1067425655:87 , srv1136171757:87 , srv1246068596:87 , srv1264545581:87 , srv142835434:87 , srv1527464926:87 , srv1560579870:87 , srv1993473431:87 , srv2068528637:87 , srv2099919191:87 , srv325632230:87 , srv428122526:87 , srv585005576:87 , srv599777741:87 , srv621653328:87 , srv676464047:87 , srv730717106:87 , srv737859285:87 , srv876960301:87 , srv902513348:87 , srv986914325:87 , srv1052739187:88 , srv1211422302:88 , srv1820063398:88 , srv575150247:88 , srv607231136:88 , srv791032429:88 , srv804005011:88 , srv924692170:88 , srv104035352:89 , srv1516486150:89 , srv1672662149:89 , srv2010499780:89 , srv2016808863:89 , srv21005776:89 , srv2110271806:89 , srv2127779190:89 , srv384696920:89 , srv65932461:89 , srv1103467920:90 , srv1136440160:90 , srv892091443:90 , srv1355312574:91 , srv1534613442:91 , srv478157295:91 , srv80221833:91 , srv367368881:92 , srv686651531:93 , srv992138552:447 }
2023-12-06 21:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1020141512=1, srv2068528637=46, srv1110463102=8, srv1876813096=37, srv902513348=93, srv2095083460=48, srv1067425655=5, srv2016808863=44, srv479737908=63, srv2110271806=51, srv142835434=25, srv861165206=89, srv597277206=70, srv384696920=59, srv730717106=80, srv2119407481=52, srv876960301=90, srv621653328=74, srv148312997=26, srv2010499780=43, srv986914325=97, srv1820063398=36, srv325632230=56, srv1246068596=17, srv1527464926=29, srv1642059281=33, srv1264545581=19, srv104035352=2, srv804005011=87, srv1691859216=35, srv1396338476=24, srv71213297=79, srv654140448=75, srv2127779190=53, srv892091443=92, srv1103467920=7, srv571738265=67, srv1136171757=11, srv486933559=64, srv21005776=50, srv478157295=62, srv65932461=76, srv80221833=85, srv955398644=96, srv330243118=57, srv599777741=71, srv1243725299=16, srv1211422302=14, srv1271869728=20, srv428122526=60, srv1979946790=41, srv466266703=61, srv733087953=81, srv676464047=77, srv1075752559=6, srv1129293560=10, srv793395359=84, srv1355312574=22, srv877493980=91, srv1393838504=23, srv924692170=95, srv126127576=18, srv992138552=98, srv686651531=78, srv1560579870=31, srv1938019029=40, srv1052739187=4, srv2064256381=45, srv992514782=99, srv367368881=58, srv819471182=88, srv1012020413=0, srv1047775158=3, srv1219492337=15, srv1145784021=13, srv737859285=82, srv903362055=94, srv1136440160=12, srv1672662149=34, srv2099919191=49, srv134338630=21, srv80338384=86, srv488390499=65, srv585005576=69, srv1930466739=38, srv1584045550=32, srv1516486150=27, srv1517652583=28, srv252430128=54, srv1128406079=9, srv61225061=73, srv1993473431=42, srv791032429=83, srv530215599=66, srv280343332=55, srv575150247=68, srv1937444726=39, srv1534613442=30, srv2073458139=47, srv607231136=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:53:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:53:15,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-06 21:53:15,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-06 21:53:15,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-06 21:53:15,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-06 21:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-06 21:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-06 21:53:15,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-06 21:53:15,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-06 21:53:15,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-06 21:53:15,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-06 21:53:15,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-06 21:53:15,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-06 21:53:15,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-06 21:53:15,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040151539856982985, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05729009410146646, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040151539856982985, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:15,618 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-06 21:53:15,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17387451456383904, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040151539856982985, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05729009410146646, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040151539856982985, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-06 21:53:15,857 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 347 ms to try 5000 different iterations.  Found a solution that moves 2592 regions; Going from a computed imbalance of 0.17387451456383904 to a new imbalance of 0.014250881724450335. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02228050717835444); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03635156926603382, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.288, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02228050717835444); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.040916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:15,867 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv686651531:79 , srv80221833:79 , srv478157295:80 , srv367368881:81 , srv65932461:81 , srv1052739187:82 , srv1136440160:82 , srv1211422302:82 , srv1355312574:82 , srv1534613442:82 , srv1672662149:82 , srv1820063398:82 , srv2099919191:82 , srv1103467920:83 , srv1560579870:83 , srv2010499780:83 , srv21005776:83 , srv428122526:83 , srv575150247:83 , srv804005011:83 , srv104035352:84 , srv1067425655:84 , srv1264545581:84 , srv142835434:84 , srv1516486150:84 , srv2016808863:84 , srv2110271806:84 , srv607231136:84 , srv892091443:84 , srv902513348:84 , srv1110463102:85 , srv1642059281:85 , srv1938019029:85 , srv1993473431:85 , srv2095083460:85 , srv2119407481:85 , srv2127779190:85 , srv325632230:85 , srv384696920:85 , srv466266703:85 , srv486933559:85 , srv585005576:85 , srv597277206:85 , srv621653328:85 , srv654140448:85 , srv730717106:85 , srv791032429:85 , srv80338384:85 , srv876960301:85 , srv924692170:85 , srv1020141512:86 , srv1246068596:86 , srv126127576:86 , srv134338630:86 , srv1393838504:86 , srv1396338476:86 , srv1930466739:86 , srv2073458139:86 , srv488390499:86 , srv571738265:86 , srv793395359:86 , srv955398644:86 , srv986914325:86 , srv1012020413:87 , srv1075752559:87 , srv1128406079:87 , srv2064256381:87 , srv2068528637:87 , srv252430128:87 , srv530215599:87 , srv676464047:87 , srv733087953:87 , srv737859285:87 , srv861165206:87 , srv877493980:87 , srv1129293560:88 , srv1136171757:88 , srv1271869728:88 , srv148312997:88 , srv1527464926:88 , srv1584045550:88 , srv1691859216:88 , srv280343332:88 , srv599777741:88 , srv61225061:88 , srv903362055:88 , srv992514782:88 , srv1145784021:89 , srv1243725299:89 , srv1517652583:89 , srv1937444726:89 , srv1979946790:89 , srv819471182:89 , srv1219492337:90 , srv1047775158:91 , srv1876813096:91 , srv479737908:91 , srv71213297:91 , srv330243118:92 , srv992138552:525 }
2023-12-06 21:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:53:15,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1020141512=1, srv2068528637=46, srv1110463102=8, srv1876813096=37, srv902513348=93, srv2095083460=48, srv1067425655=5, srv2016808863=44, srv479737908=63, srv2110271806=51, srv142835434=25, srv861165206=89, srv597277206=70, srv384696920=59, srv730717106=80, srv2119407481=52, srv876960301=90, srv621653328=74, srv148312997=26, srv2010499780=43, srv986914325=97, srv1820063398=36, srv325632230=56, srv1246068596=17, srv1527464926=29, srv1642059281=33, srv1264545581=19, srv104035352=2, srv804005011=87, srv1691859216=35, srv1396338476=24, srv71213297=79, srv654140448=75, srv2127779190=53, srv892091443=92, srv1103467920=7, srv571738265=67, srv1136171757=11, srv486933559=64, srv21005776=50, srv478157295=62, srv65932461=76, srv80221833=85, srv955398644=96, srv330243118=57, srv599777741=71, srv1243725299=16, srv1211422302=14, srv1271869728=20, srv428122526=60, srv1979946790=41, srv466266703=61, srv733087953=81, srv676464047=77, srv1075752559=6, srv1129293560=10, srv793395359=84, srv1355312574=22, srv877493980=91, srv1393838504=23, srv924692170=95, srv126127576=18, srv992138552=98, srv686651531=78, srv1560579870=31, srv1938019029=40, srv1052739187=4, srv2064256381=45, srv992514782=99, srv367368881=58, srv819471182=88, srv1012020413=0, srv1047775158=3, srv1219492337=15, srv1145784021=13, srv737859285=82, srv903362055=94, srv1136440160=12, srv1672662149=34, srv2099919191=49, srv134338630=21, srv80338384=86, srv488390499=65, srv585005576=69, srv1930466739=38, srv1584045550=32, srv1516486150=27, srv1517652583=28, srv252430128=54, srv1128406079=9, srv61225061=73, srv1993473431=42, srv791032429=83, srv530215599=66, srv280343332=55, srv575150247=68, srv1937444726=39, srv1534613442=30, srv2073458139=47, srv607231136=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-06 21:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-06 21:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-06 21:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-06 21:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-06 21:53:15,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-06 21:53:15,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-06 21:53:15,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-06 21:53:15,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-06 21:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-06 21:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-06 21:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-06 21:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-06 21:53:15,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-06 21:53:16,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02228050717835444); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03635156926603382, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02228050717835444); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.040916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:16,029 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-06 21:53:16,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014232732152531756, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02228050717835444); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03635156926603382, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02228050717835444); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.040916666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-06 21:53:16,467 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 983 regions; Going from a computed imbalance of 0.014232732152531756 to a new imbalance of 3.503304082816777E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.10922222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00225); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:16,470 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1136171757:82 , srv330243118:82 , srv104035352:83 , srv1145784021:83 , srv1527464926:83 , srv1876813096:83 , srv1979946790:83 , srv599777741:83 , srv676464047:83 , srv71213297:83 , srv892091443:83 , srv1219492337:84 , srv134338630:84 , srv1355312574:84 , srv1534613442:84 , srv1937444726:84 , srv2068528637:84 , srv2127779190:84 , srv252430128:84 , srv367368881:84 , srv384696920:84 , srv479737908:84 , srv737859285:84 , srv986914325:84 , srv992514782:84 , srv1047775158:85 , srv1103467920:85 , srv1128406079:85 , srv1129293560:85 , srv1136440160:85 , srv1246068596:85 , srv1396338476:85 , srv148312997:85 , srv1516486150:85 , srv1691859216:85 , srv1930466739:85 , srv1993473431:85 , srv2016808863:85 , srv2064256381:85 , srv21005776:85 , srv2110271806:85 , srv280343332:85 , srv488390499:85 , srv585005576:85 , srv597277206:85 , srv607231136:85 , srv730717106:85 , srv791032429:85 , srv924692170:85 , srv955398644:85 , srv1243725299:86 , srv1271869728:86 , srv1393838504:86 , srv1517652583:86 , srv1584045550:86 , srv2010499780:86 , srv2073458139:86 , srv2095083460:86 , srv2119407481:86 , srv428122526:86 , srv478157295:86 , srv530215599:86 , srv61225061:86 , srv621653328:86 , srv654140448:86 , srv686651531:86 , srv80338384:86 , srv819471182:86 , srv861165206:86 , srv876960301:86 , srv877493980:86 , srv902513348:86 , srv903362055:86 , srv1012020413:87 , srv1020141512:87 , srv1052739187:87 , srv1067425655:87 , srv1075752559:87 , srv1211422302:87 , srv126127576:87 , srv1264545581:87 , srv142835434:87 , srv1672662149:87 , srv325632230:87 , srv571738265:87 , srv575150247:87 , srv733087953:87 , srv793395359:87 , srv80221833:87 , srv804005011:87 , srv1560579870:88 , srv1642059281:88 , srv1820063398:88 , srv1938019029:88 , srv466266703:88 , srv486933559:88 , srv65932461:88 , srv1110463102:89 , srv2099919191:89 , srv992138552:537 }
2023-12-06 21:53:16,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:53:16,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1020141512=1, srv2068528637=46, srv1110463102=8, srv1876813096=37, srv902513348=93, srv2095083460=48, srv1067425655=5, srv2016808863=44, srv479737908=63, srv2110271806=51, srv142835434=25, srv861165206=89, srv597277206=70, srv384696920=59, srv730717106=80, srv2119407481=52, srv876960301=90, srv621653328=74, srv148312997=26, srv2010499780=43, srv986914325=97, srv1820063398=36, srv325632230=56, srv1246068596=17, srv1527464926=29, srv1642059281=33, srv1264545581=19, srv104035352=2, srv804005011=87, srv1691859216=35, srv1396338476=24, srv71213297=79, srv654140448=75, srv2127779190=53, srv892091443=92, srv1103467920=7, srv571738265=67, srv1136171757=11, srv486933559=64, srv21005776=50, srv478157295=62, srv65932461=76, srv80221833=85, srv955398644=96, srv330243118=57, srv599777741=71, srv1243725299=16, srv1211422302=14, srv1271869728=20, srv428122526=60, srv1979946790=41, srv466266703=61, srv733087953=81, srv676464047=77, srv1075752559=6, srv1129293560=10, srv793395359=84, srv1355312574=22, srv877493980=91, srv1393838504=23, srv924692170=95, srv126127576=18, srv992138552=98, srv686651531=78, srv1560579870=31, srv1938019029=40, srv1052739187=4, srv2064256381=45, srv992514782=99, srv367368881=58, srv819471182=88, srv1012020413=0, srv1047775158=3, srv1219492337=15, srv1145784021=13, srv737859285=82, srv903362055=94, srv1136440160=12, srv1672662149=34, srv2099919191=49, srv134338630=21, srv80338384=86, srv488390499=65, srv585005576=69, srv1930466739=38, srv1584045550=32, srv1516486150=27, srv1517652583=28, srv252430128=54, srv1128406079=9, srv61225061=73, srv1993473431=42, srv791032429=83, srv530215599=66, srv280343332=55, srv575150247=68, srv1937444726=39, srv1534613442=30, srv2073458139=47, srv607231136=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-06 21:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-06 21:53:16,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-06 21:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-06 21:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-06 21:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-06 21:53:16,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00225); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:16,609 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-06 21:53:16,610 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.434472951659512E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00225); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-06 21:53:16,940 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 434 ms to try 5000 different iterations.  Found a solution that moves 218 regions; Going from a computed imbalance of 3.434472951659512E-4 to a new imbalance of 1.2471100282356722E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.02422222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:16,941 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1110463102:83 , srv1672662149:83 , srv1938019029:83 , srv325632230:83 , srv819471182:83 , srv1012020413:84 , srv1020141512:84 , srv1047775158:84 , srv1052739187:84 , srv1067425655:84 , srv1128406079:84 , srv1129293560:84 , srv1145784021:84 , srv1219492337:84 , srv1243725299:84 , srv1246068596:84 , srv1264545581:84 , srv1393838504:84 , srv1516486150:84 , srv1517652583:84 , srv1527464926:84 , srv1560579870:84 , srv1642059281:84 , srv1691859216:84 , srv1820063398:84 , srv1937444726:84 , srv1993473431:84 , srv2010499780:84 , srv2016808863:84 , srv2064256381:84 , srv2068528637:84 , srv2073458139:84 , srv2099919191:84 , srv2110271806:84 , srv2127779190:84 , srv384696920:84 , srv466266703:84 , srv479737908:84 , srv486933559:84 , srv571738265:84 , srv575150247:84 , srv599777741:84 , srv61225061:84 , srv621653328:84 , srv65932461:84 , srv686651531:84 , srv737859285:84 , srv80338384:84 , srv804005011:84 , srv861165206:84 , srv876960301:84 , srv924692170:84 , srv104035352:85 , srv1075752559:85 , srv1103467920:85 , srv1136171757:85 , srv1136440160:85 , srv1211422302:85 , srv126127576:85 , srv1355312574:85 , srv142835434:85 , srv148312997:85 , srv1534613442:85 , srv1584045550:85 , srv1979946790:85 , srv2095083460:85 , srv21005776:85 , srv2119407481:85 , srv252430128:85 , srv280343332:85 , srv330243118:85 , srv367368881:85 , srv478157295:85 , srv488390499:85 , srv530215599:85 , srv585005576:85 , srv607231136:85 , srv654140448:85 , srv676464047:85 , srv730717106:85 , srv733087953:85 , srv791032429:85 , srv793395359:85 , srv80221833:85 , srv877493980:85 , srv892091443:85 , srv902513348:85 , srv903362055:85 , srv955398644:85 , srv986914325:85 , srv992514782:85 , srv1271869728:86 , srv1396338476:86 , srv1876813096:86 , srv1930466739:86 , srv428122526:86 , srv597277206:86 , srv71213297:86 , srv134338630:87 , srv992138552:633 }
2023-12-06 21:53:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:53:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1020141512=1, srv2068528637=46, srv1110463102=8, srv1876813096=37, srv902513348=93, srv2095083460=48, srv1067425655=5, srv2016808863=44, srv479737908=63, srv2110271806=51, srv142835434=25, srv861165206=89, srv597277206=70, srv384696920=59, srv730717106=80, srv2119407481=52, srv876960301=90, srv621653328=74, srv148312997=26, srv2010499780=43, srv986914325=97, srv1820063398=36, srv325632230=56, srv1246068596=17, srv1527464926=29, srv1642059281=33, srv1264545581=19, srv104035352=2, srv804005011=87, srv1691859216=35, srv1396338476=24, srv71213297=79, srv654140448=75, srv2127779190=53, srv892091443=92, srv1103467920=7, srv571738265=67, srv1136171757=11, srv486933559=64, srv21005776=50, srv478157295=62, srv65932461=76, srv80221833=85, srv955398644=96, srv330243118=57, srv599777741=71, srv1243725299=16, srv1211422302=14, srv1271869728=20, srv428122526=60, srv1979946790=41, srv466266703=61, srv733087953=81, srv676464047=77, srv1075752559=6, srv1129293560=10, srv793395359=84, srv1355312574=22, srv877493980=91, srv1393838504=23, srv924692170=95, srv126127576=18, srv992138552=98, srv686651531=78, srv1560579870=31, srv1938019029=40, srv1052739187=4, srv2064256381=45, srv992514782=99, srv367368881=58, srv819471182=88, srv1012020413=0, srv1047775158=3, srv1219492337=15, srv1145784021=13, srv737859285=82, srv903362055=94, srv1136440160=12, srv1672662149=34, srv2099919191=49, srv134338630=21, srv80338384=86, srv488390499=65, srv585005576=69, srv1930466739=38, srv1584045550=32, srv1516486150=27, srv1517652583=28, srv252430128=54, srv1128406079=9, srv61225061=73, srv1993473431=42, srv791032429=83, srv530215599=66, srv280343332=55, srv575150247=68, srv1937444726=39, srv1534613442=30, srv2073458139=47, srv607231136=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:53:16,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:53:16,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:53:16,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-06 21:53:16,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-06 21:53:16,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-06 21:53:16,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-06 21:53:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-06 21:53:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-06 21:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-06 21:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-06 21:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-06 21:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-06 21:53:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-06 21:53:17,113 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.0944631656488581E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:17,114 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1110463102:83 , srv1672662149:83 , srv1938019029:83 , srv325632230:83 , srv819471182:83 , srv1012020413:84 , srv1020141512:84 , srv1047775158:84 , srv1052739187:84 , srv1067425655:84 , srv1128406079:84 , srv1129293560:84 , srv1145784021:84 , srv1219492337:84 , srv1243725299:84 , srv1246068596:84 , srv1264545581:84 , srv1393838504:84 , srv1516486150:84 , srv1517652583:84 , srv1527464926:84 , srv1560579870:84 , srv1642059281:84 , srv1691859216:84 , srv1820063398:84 , srv1937444726:84 , srv1993473431:84 , srv2010499780:84 , srv2016808863:84 , srv2064256381:84 , srv2068528637:84 , srv2073458139:84 , srv2099919191:84 , srv2110271806:84 , srv2127779190:84 , srv384696920:84 , srv466266703:84 , srv479737908:84 , srv486933559:84 , srv571738265:84 , srv575150247:84 , srv599777741:84 , srv61225061:84 , srv621653328:84 , srv65932461:84 , srv686651531:84 , srv737859285:84 , srv80338384:84 , srv804005011:84 , srv861165206:84 , srv876960301:84 , srv924692170:84 , srv104035352:85 , srv1075752559:85 , srv1103467920:85 , srv1136171757:85 , srv1136440160:85 , srv1211422302:85 , srv126127576:85 , srv1355312574:85 , srv142835434:85 , srv148312997:85 , srv1534613442:85 , srv1584045550:85 , srv1979946790:85 , srv2095083460:85 , srv21005776:85 , srv2119407481:85 , srv252430128:85 , srv280343332:85 , srv330243118:85 , srv367368881:85 , srv478157295:85 , srv488390499:85 , srv530215599:85 , srv585005576:85 , srv607231136:85 , srv654140448:85 , srv676464047:85 , srv730717106:85 , srv733087953:85 , srv791032429:85 , srv793395359:85 , srv80221833:85 , srv877493980:85 , srv892091443:85 , srv902513348:85 , srv903362055:85 , srv955398644:85 , srv986914325:85 , srv992514782:85 , srv1271869728:86 , srv1396338476:86 , srv1876813096:86 , srv1930466739:86 , srv428122526:86 , srv597277206:86 , srv71213297:86 , srv134338630:87 , srv992138552:633 }
2023-12-06 21:53:17,147 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 264), ProcessCount=170 (was 170), AvailableMemoryMB=11957 (was 12774)
2023-12-06 21:53:17,159 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=264, ProcessCount=170, AvailableMemoryMB=11957
2023-12-06 21:53:17,159 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-06 21:53:17,160 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-06 21:53:17,172 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019593681:84 , srv1065085819:84 , srv1115697218:84 , srv1149318070:84 , srv1167314063:84 , srv1313471204:84 , srv1369485493:84 , srv1379088272:84 , srv1399269342:84 , srv1465046029:84 , srv1522952587:84 , srv1550369082:84 , srv1576897057:84 , srv1720650727:84 , srv1787310920:84 , srv1805925291:84 , srv1810658931:84 , srv1943735708:84 , srv2047114154:84 , srv2049423887:84 , srv370330881:84 , srv373738592:84 , srv417303275:84 , srv537082908:84 , srv658165709:84 , srv776559612:84 , srv91295086:84 , srv921925305:84 , srv979545112:84 , srv1852517070:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-06 21:53:17,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:53:17,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465046029=9, srv1810658931=16, srv1313471204=5, srv776559612=26, srv373738592=22, srv1399269342=8, srv537082908=24, srv658165709=25, srv370330881=21, srv91295086=27, srv1149318070=3, srv1550369082=11, srv1379088272=7, srv1720650727=13, srv1805925291=15, srv2047114154=19, srv417303275=23, srv1369485493=6, srv979545112=29, srv1787310920=14, srv1065085819=1, srv1522952587=10, srv1943735708=18, srv1576897057=12, srv1019593681=0, srv1115697218=2, srv1852517070=17, srv921925305=28, srv1167314063=4, srv2049423887=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:53:17,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:53:17,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:53:17,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:53:17,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:53:17,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:53:17,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:53:17,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:53:17,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:53:17,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:53:17,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-06 21:53:17,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1583087251822892, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:53:17,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912691868888073, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1583087251822892, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-06 21:55:17,195 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5452691 different iterations.  Found a solution that moves 1868 regions; Going from a computed imbalance of 0.9912691868888073 to a new imbalance of 4.360005188259462E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6918518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:55:17,201 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1019593681:90 , srv1065085819:90 , srv1115697218:90 , srv1149318070:90 , srv1167314063:90 , srv1313471204:90 , srv1369485493:90 , srv1379088272:90 , srv1399269342:90 , srv1465046029:90 , srv1522952587:90 , srv1550369082:90 , srv1576897057:90 , srv1720650727:90 , srv1787310920:90 , srv1805925291:90 , srv1810658931:90 , srv1852517070:90 , srv1943735708:90 , srv2047114154:90 , srv2049423887:90 , srv370330881:90 , srv373738592:90 , srv417303275:90 , srv537082908:90 , srv658165709:90 , srv776559612:90 , srv91295086:90 , srv921925305:90 , srv979545112:90 }
2023-12-06 21:55:17,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-06 21:55:17,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465046029=9, srv1810658931=16, srv1313471204=5, srv776559612=26, srv373738592=22, srv1399269342=8, srv537082908=24, srv658165709=25, srv370330881=21, srv91295086=27, srv1149318070=3, srv1550369082=11, srv1379088272=7, srv1720650727=13, srv1805925291=15, srv2047114154=19, srv417303275=23, srv1369485493=6, srv979545112=29, srv1787310920=14, srv1065085819=1, srv1522952587=10, srv1943735708=18, srv1576897057=12, srv1019593681=0, srv1115697218=2, srv1852517070=17, srv921925305=28, srv1167314063=4, srv2049423887=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-06 21:55:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-06 21:55:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-06 21:55:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-06 21:55:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-06 21:55:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-06 21:55:17,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-06 21:55:17,231 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1019593681:90 , srv1065085819:90 , srv1115697218:90 , srv1149318070:90 , srv1167314063:90 , srv1313471204:90 , srv1369485493:90 , srv1379088272:90 , srv1399269342:90 , srv1465046029:90 , srv1522952587:90 , srv1550369082:90 , srv1576897057:90 , srv1720650727:90 , srv1787310920:90 , srv1805925291:90 , srv1810658931:90 , srv1852517070:90 , srv1943735708:90 , srv2047114154:90 , srv2049423887:90 , srv370330881:90 , srv373738592:90 , srv417303275:90 , srv537082908:90 , srv658165709:90 , srv776559612:90 , srv91295086:90 , srv921925305:90 , srv979545112:90 }
2023-12-06 21:55:17,251 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=142 (was 264), ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=11254 (was 11957)