2024-01-25 12:53:11,684 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-25 12:53:12,013 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-25 12:53:12,127 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-25 12:53:12,188 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-25 12:53:12,196 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-25 12:53:12,213 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=169, AvailableMemoryMB=10146
2024-01-25 12:53:12,215 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-25 12:53:12,215 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-25 12:53:12,348 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011856946:84 , srv1031841676:84 , srv1052866489:84 , srv1058071188:84 , srv1086980187:84 , srv1139401787:84 , srv1160167527:84 , srv1163601561:84 , srv1164424190:84 , srv1166137552:84 , srv1170617532:84 , srv1281632759:84 , srv1330177019:84 , srv1409197288:84 , srv1411348428:84 , srv1428894170:84 , srv1440795974:84 , srv1443555281:84 , srv1472337547:84 , srv1504173917:84 , srv1509107493:84 , srv1521048815:84 , srv1582197537:84 , srv1609460970:84 , srv1615534055:84 , srv1639099760:84 , srv1656618228:84 , srv1707841578:84 , srv1712862400:84 , srv1720149868:84 , srv1749853602:84 , srv1769899622:84 , srv1798023996:84 , srv1798485235:84 , srv1845273080:84 , srv1868163421:84 , srv1868853876:84 , srv1906685996:84 , srv191074583:84 , srv1953093620:84 , srv1959060666:84 , srv1966303656:84 , srv1981823333:84 , srv2009145629:84 , srv201831050:84 , srv2039469328:84 , srv2046792487:84 , srv208960005:84 , srv2090915498:84 , srv223243816:84 , srv255274262:84 , srv260572213:84 , srv285444720:84 , srv289462815:84 , srv322715:84 , srv325672539:84 , srv330367918:84 , srv342557548:84 , srv355824064:84 , srv363493963:84 , srv36761491:84 , srv375542901:84 , srv398956782:84 , srv410115870:84 , srv437122063:84 , srv441563680:84 , srv483409564:84 , srv486668455:84 , srv490215866:84 , srv505156222:84 , srv537881564:84 , srv590362480:84 , srv600312393:84 , srv607318591:84 , srv610937799:84 , srv611434414:84 , srv619971617:84 , srv698051083:84 , srv698253163:84 , srv707327247:84 , srv71567078:84 , srv735612714:84 , srv741489571:84 , srv764521791:84 , srv766527124:84 , srv800391038:84 , srv823736451:84 , srv826957056:84 , srv857026488:84 , srv863450384:84 , srv872012070:84 , srv886180388:84 , srv891552962:84 , srv902070622:84 , srv925944003:84 , srv938126050:84 , srv940586170:84 , srv982545788:84 , srv990291218:84 , srv2036915981:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-25 12:53:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:12,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1720149868=29, srv208960005=48, srv891552962=93, srv902070622=94, srv1164424190=8, srv1330177019=12, srv1521048815=21, srv1639099760=25, srv1052866489=2, srv1582197537=22, srv766527124=85, srv1411348428=14, srv71567078=81, srv191074583=38, srv355824064=59, srv441563680=66, srv1798023996=32, srv1163601561=7, srv1058071188=3, srv1166137552=9, srv483409564=67, srv1656618228=26, srv1981823333=42, srv1160167527=6, srv1031841676=1, srv325672539=56, srv2036915981=45, srv610937799=75, srv201831050=44, srv823736451=87, srv1409197288=13, srv260572213=52, srv1868163421=35, srv872012070=91, srv938126050=96, srv800391038=86, srv1281632759=11, srv611434414=76, srv990291218=99, srv330367918=57, srv607318591=74, srv1170617532=10, srv1440795974=16, srv1707841578=27, srv398956782=63, srv1011856946=0, srv1139401787=5, srv698051083=78, srv982545788=98, srv486668455=68, srv490215866=69, srv764521791=84, srv1509107493=20, srv2090915498=49, srv2009145629=43, srv886180388=92, srv590362480=72, srv698253163=79, srv1906685996=37, srv285444720=53, srv925944003=95, srv36761491=61, srv707327247=80, srv1472337547=18, srv1953093620=39, srv1712862400=28, srv255274262=51, srv505156222=70, srv375542901=62, srv437122063=65, srv1086980187=4, srv363493963=60, srv1845273080=34, srv741489571=83, srv600312393=73, srv322715=55, srv1966303656=41, srv2039469328=46, srv1615534055=24, srv1504173917=19, srv1959060666=40, srv1769899622=31, srv410115870=64, srv863450384=90, srv735612714=82, srv857026488=89, srv1428894170=15, srv223243816=50, srv940586170=97, srv342557548=58, srv537881564=71, srv619971617=77, srv289462815=54, srv1443555281=17, srv2046792487=47, srv1609460970=23, srv826957056=88, srv1798485235=33, srv1749853602=30, srv1868853876=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:12,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:12,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:12,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:12,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-25 12:53:12,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-25 12:53:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-25 12:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-25 12:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-25 12:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-25 12:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-25 12:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-25 12:53:12,785 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:12,786 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-25 12:53:12,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-25 12:53:13,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 763 ms to try 5000 different iterations.  Found a solution that moves 4655 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1854019465751923. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041750570217429166, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05586981822149822, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5172222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041750570217429166, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:13,267 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1749853602:80 , srv1160167527:81 , srv735612714:81 , srv437122063:82 , srv600312393:82 , srv925944003:82 , srv1163601561:83 , srv1504173917:83 , srv1521048815:83 , srv1707841578:83 , srv191074583:83 , srv1966303656:83 , srv823736451:83 , srv857026488:83 , srv938126050:83 , srv1615534055:84 , srv1720149868:84 , srv1769899622:84 , srv1798023996:84 , srv325672539:84 , srv483409564:84 , srv537881564:84 , srv940586170:84 , srv990291218:84 , srv1052866489:85 , srv1170617532:85 , srv1639099760:85 , srv1656618228:85 , srv1712862400:85 , srv1981823333:85 , srv2009145629:85 , srv2039469328:85 , srv2046792487:85 , srv255274262:85 , srv375542901:85 , srv486668455:85 , srv698253163:85 , srv764521791:85 , srv766527124:85 , srv1058071188:86 , srv1166137552:86 , srv1411348428:86 , srv1509107493:86 , srv1609460970:86 , srv1798485235:86 , srv1868163421:86 , srv1868853876:86 , srv208960005:86 , srv260572213:86 , srv355824064:86 , srv398956782:86 , srv505156222:86 , srv590362480:86 , srv607318591:86 , srv610937799:86 , srv611434414:86 , srv741489571:86 , srv800391038:86 , srv872012070:86 , srv1011856946:87 , srv1086980187:87 , srv1330177019:87 , srv201831050:87 , srv2090915498:87 , srv223243816:87 , srv285444720:87 , srv322715:87 , srv363493963:87 , srv36761491:87 , srv441563680:87 , srv863450384:87 , srv902070622:87 , srv1409197288:88 , srv1845273080:88 , srv1906685996:88 , srv1959060666:88 , srv342557548:88 , srv490215866:88 , srv707327247:88 , srv71567078:88 , srv891552962:88 , srv982545788:88 , srv1031841676:89 , srv1472337547:89 , srv289462815:89 , srv410115870:89 , srv886180388:89 , srv1281632759:90 , srv1428894170:90 , srv1582197537:90 , srv1953093620:90 , srv330367918:90 , srv698051083:90 , srv619971617:91 , srv1440795974:92 , srv1443555281:92 , srv1164424190:93 , srv826957056:93 , srv1139401787:96 , srv2036915981:461 }
2024-01-25 12:53:13,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:13,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1720149868=29, srv208960005=48, srv891552962=93, srv902070622=94, srv1164424190=8, srv1330177019=12, srv1521048815=21, srv1639099760=25, srv1052866489=2, srv1582197537=22, srv766527124=85, srv1411348428=14, srv71567078=81, srv191074583=38, srv355824064=59, srv441563680=66, srv1798023996=32, srv1163601561=7, srv1058071188=3, srv1166137552=9, srv483409564=67, srv1656618228=26, srv1981823333=42, srv1160167527=6, srv1031841676=1, srv325672539=56, srv2036915981=45, srv610937799=75, srv201831050=44, srv823736451=87, srv1409197288=13, srv260572213=52, srv1868163421=35, srv872012070=91, srv938126050=96, srv800391038=86, srv1281632759=11, srv611434414=76, srv990291218=99, srv330367918=57, srv607318591=74, srv1170617532=10, srv1440795974=16, srv1707841578=27, srv398956782=63, srv1011856946=0, srv1139401787=5, srv698051083=78, srv982545788=98, srv486668455=68, srv490215866=69, srv764521791=84, srv1509107493=20, srv2090915498=49, srv2009145629=43, srv886180388=92, srv590362480=72, srv698253163=79, srv1906685996=37, srv285444720=53, srv925944003=95, srv36761491=61, srv707327247=80, srv1472337547=18, srv1953093620=39, srv1712862400=28, srv255274262=51, srv505156222=70, srv375542901=62, srv437122063=65, srv1086980187=4, srv363493963=60, srv1845273080=34, srv741489571=83, srv600312393=73, srv322715=55, srv1966303656=41, srv2039469328=46, srv1615534055=24, srv1504173917=19, srv1959060666=40, srv1769899622=31, srv410115870=64, srv863450384=90, srv735612714=82, srv857026488=89, srv1428894170=15, srv223243816=50, srv940586170=97, srv342557548=58, srv537881564=71, srv619971617=77, srv289462815=54, srv1443555281=17, srv2046792487=47, srv1609460970=23, srv826957056=88, srv1798485235=33, srv1749853602=30, srv1868853876=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-25 12:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-25 12:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-25 12:53:13,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-25 12:53:13,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-25 12:53:13,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-25 12:53:13,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-25 12:53:13,446 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041750570217429166, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05586981822149822, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041750570217429166, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:13,447 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-25 12:53:13,447 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18536935156852521, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041750570217429166, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05586981822149822, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041750570217429166, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-25 12:53:13,769 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 2668 regions; Going from a computed imbalance of 0.18536935156852521 to a new imbalance of 0.014248346264477183. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022049270859364138); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03258417399692262, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29644444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022049270859364138); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:13,780 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1139401787:77 , srv1440795974:78 , srv1443555281:78 , srv826957056:79 , srv1164424190:80 , srv1031841676:81 , srv1281632759:81 , srv1582197537:81 , srv1409197288:82 , srv1428894170:82 , srv1906685996:82 , srv1953093620:82 , srv330367918:82 , srv363493963:82 , srv619971617:82 , srv1472337547:83 , srv2090915498:83 , srv342557548:83 , srv698051083:83 , srv71567078:83 , srv891552962:83 , srv1959060666:84 , srv698253163:84 , srv902070622:84 , srv982545788:84 , srv1011856946:85 , srv1086980187:85 , srv1411348428:85 , srv1509107493:85 , srv1609460970:85 , srv1845273080:85 , srv1868163421:85 , srv2009145629:85 , srv208960005:85 , srv36761491:85 , srv410115870:85 , srv490215866:85 , srv863450384:85 , srv872012070:85 , srv886180388:85 , srv1330177019:86 , srv1712862400:86 , srv1769899622:86 , srv1798485235:86 , srv1868853876:86 , srv2046792487:86 , srv223243816:86 , srv260572213:86 , srv289462815:86 , srv322715:86 , srv355824064:86 , srv398956782:86 , srv441563680:86 , srv486668455:86 , srv505156222:86 , srv590362480:86 , srv707327247:86 , srv741489571:86 , srv764521791:86 , srv800391038:86 , srv1170617532:87 , srv1656618228:87 , srv1720149868:87 , srv1981823333:87 , srv201831050:87 , srv2039469328:87 , srv285444720:87 , srv325672539:87 , srv607318591:87 , srv610937799:87 , srv766527124:87 , srv823736451:87 , srv857026488:87 , srv940586170:87 , srv1058071188:88 , srv1166137552:88 , srv1504173917:88 , srv1639099760:88 , srv1707841578:88 , srv1798023996:88 , srv255274262:88 , srv437122063:88 , srv483409564:88 , srv990291218:88 , srv1052866489:89 , srv1521048815:89 , srv191074583:89 , srv1966303656:89 , srv375542901:89 , srv537881564:89 , srv611434414:89 , srv1615534055:90 , srv1163601561:91 , srv600312393:91 , srv735612714:91 , srv1160167527:92 , srv1749853602:92 , srv925944003:92 , srv938126050:93 , srv2036915981:509 }
2024-01-25 12:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1720149868=29, srv208960005=48, srv891552962=93, srv902070622=94, srv1164424190=8, srv1330177019=12, srv1521048815=21, srv1639099760=25, srv1052866489=2, srv1582197537=22, srv766527124=85, srv1411348428=14, srv71567078=81, srv191074583=38, srv355824064=59, srv441563680=66, srv1798023996=32, srv1163601561=7, srv1058071188=3, srv1166137552=9, srv483409564=67, srv1656618228=26, srv1981823333=42, srv1160167527=6, srv1031841676=1, srv325672539=56, srv2036915981=45, srv610937799=75, srv201831050=44, srv823736451=87, srv1409197288=13, srv260572213=52, srv1868163421=35, srv872012070=91, srv938126050=96, srv800391038=86, srv1281632759=11, srv611434414=76, srv990291218=99, srv330367918=57, srv607318591=74, srv1170617532=10, srv1440795974=16, srv1707841578=27, srv398956782=63, srv1011856946=0, srv1139401787=5, srv698051083=78, srv982545788=98, srv486668455=68, srv490215866=69, srv764521791=84, srv1509107493=20, srv2090915498=49, srv2009145629=43, srv886180388=92, srv590362480=72, srv698253163=79, srv1906685996=37, srv285444720=53, srv925944003=95, srv36761491=61, srv707327247=80, srv1472337547=18, srv1953093620=39, srv1712862400=28, srv255274262=51, srv505156222=70, srv375542901=62, srv437122063=65, srv1086980187=4, srv363493963=60, srv1845273080=34, srv741489571=83, srv600312393=73, srv322715=55, srv1966303656=41, srv2039469328=46, srv1615534055=24, srv1504173917=19, srv1959060666=40, srv1769899622=31, srv410115870=64, srv863450384=90, srv735612714=82, srv857026488=89, srv1428894170=15, srv223243816=50, srv940586170=97, srv342557548=58, srv537881564=71, srv619971617=77, srv289462815=54, srv1443555281=17, srv2046792487=47, srv1609460970=23, srv826957056=88, srv1798485235=33, srv1749853602=30, srv1868853876=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-25 12:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-25 12:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-25 12:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-25 12:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-25 12:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-25 12:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-25 12:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-25 12:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-25 12:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-25 12:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-25 12:53:13,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022049270859364138); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03258417399692262, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022049270859364138); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:13,929 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-25 12:53:13,929 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01422966452918445, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022049270859364138); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03258417399692262, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022049270859364138); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-25 12:53:14,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 507 ms to try 5000 different iterations.  Found a solution that moves 966 regions; Going from a computed imbalance of 0.01422966452918445 to a new imbalance of 9.321850656687519E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00510031553982802); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.10733333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00510031553982802); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:14,333 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv938126050:81 , srv1615534055:83 , srv201831050:83 , srv285444720:83 , srv289462815:83 , srv410115870:83 , srv707327247:83 , srv1052866489:84 , srv1160167527:84 , srv1163601561:84 , srv1166137552:84 , srv1170617532:84 , srv1639099760:84 , srv322715:84 , srv375542901:84 , srv490215866:84 , srv600312393:84 , srv610937799:84 , srv611434414:84 , srv698051083:84 , srv1011856946:85 , srv1058071188:85 , srv1086980187:85 , srv1139401787:85 , srv1164424190:85 , srv1330177019:85 , srv1521048815:85 , srv1798023996:85 , srv1798485235:85 , srv1845273080:85 , srv1868853876:85 , srv191074583:85 , srv1953093620:85 , srv1959060666:85 , srv2039469328:85 , srv223243816:85 , srv255274262:85 , srv260572213:85 , srv330367918:85 , srv36761491:85 , srv441563680:85 , srv505156222:85 , srv537881564:85 , srv607318591:85 , srv619971617:85 , srv766527124:85 , srv800391038:85 , srv826957056:85 , srv863450384:85 , srv886180388:85 , srv925944003:85 , srv982545788:85 , srv990291218:85 , srv1281632759:86 , srv1472337547:86 , srv1504173917:86 , srv1656618228:86 , srv1707841578:86 , srv1749853602:86 , srv1868163421:86 , srv1966303656:86 , srv1981823333:86 , srv342557548:86 , srv355824064:86 , srv398956782:86 , srv483409564:86 , srv590362480:86 , srv71567078:86 , srv735612714:86 , srv741489571:86 , srv764521791:86 , srv902070622:86 , srv940586170:86 , srv1031841676:87 , srv1409197288:87 , srv1428894170:87 , srv1440795974:87 , srv1443555281:87 , srv1509107493:87 , srv1582197537:87 , srv1609460970:87 , srv1712862400:87 , srv1720149868:87 , srv1906685996:87 , srv2009145629:87 , srv2046792487:87 , srv208960005:87 , srv2090915498:87 , srv325672539:87 , srv872012070:87 , srv891552962:87 , srv1411348428:88 , srv1769899622:88 , srv363493963:88 , srv437122063:88 , srv486668455:88 , srv823736451:88 , srv857026488:88 , srv698253163:89 , srv2036915981:533 }
2024-01-25 12:53:14,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:14,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1720149868=29, srv208960005=48, srv891552962=93, srv902070622=94, srv1164424190=8, srv1330177019=12, srv1521048815=21, srv1639099760=25, srv1052866489=2, srv1582197537=22, srv766527124=85, srv1411348428=14, srv71567078=81, srv191074583=38, srv355824064=59, srv441563680=66, srv1798023996=32, srv1163601561=7, srv1058071188=3, srv1166137552=9, srv483409564=67, srv1656618228=26, srv1981823333=42, srv1160167527=6, srv1031841676=1, srv325672539=56, srv2036915981=45, srv610937799=75, srv201831050=44, srv823736451=87, srv1409197288=13, srv260572213=52, srv1868163421=35, srv872012070=91, srv938126050=96, srv800391038=86, srv1281632759=11, srv611434414=76, srv990291218=99, srv330367918=57, srv607318591=74, srv1170617532=10, srv1440795974=16, srv1707841578=27, srv398956782=63, srv1011856946=0, srv1139401787=5, srv698051083=78, srv982545788=98, srv486668455=68, srv490215866=69, srv764521791=84, srv1509107493=20, srv2090915498=49, srv2009145629=43, srv886180388=92, srv590362480=72, srv698253163=79, srv1906685996=37, srv285444720=53, srv925944003=95, srv36761491=61, srv707327247=80, srv1472337547=18, srv1953093620=39, srv1712862400=28, srv255274262=51, srv505156222=70, srv375542901=62, srv437122063=65, srv1086980187=4, srv363493963=60, srv1845273080=34, srv741489571=83, srv600312393=73, srv322715=55, srv1966303656=41, srv2039469328=46, srv1615534055=24, srv1504173917=19, srv1959060666=40, srv1769899622=31, srv410115870=64, srv863450384=90, srv735612714=82, srv857026488=89, srv1428894170=15, srv223243816=50, srv940586170=97, srv342557548=58, srv537881564=71, srv619971617=77, srv289462815=54, srv1443555281=17, srv2046792487=47, srv1609460970=23, srv826957056=88, srv1798485235=33, srv1749853602=30, srv1868853876=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-25 12:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-25 12:53:14,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-25 12:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-25 12:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-25 12:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-25 12:53:14,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-25 12:53:14,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-25 12:53:14,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-25 12:53:14,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-25 12:53:14,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-25 12:53:14,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-25 12:53:14,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-25 12:53:14,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-25 12:53:14,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-25 12:53:14,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-25 12:53:14,520 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00510031553982802); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00510031553982802); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:14,521 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-25 12:53:14,521 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.254209890972443E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00510031553982802); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00510031553982802); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-25 12:53:14,864 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 487 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 9.254209890972443E-4 to a new imbalance of 3.5940375312708976E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:14,865 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1411348428:83 , srv1428894170:83 , srv486668455:83 , srv611434414:83 , srv925944003:83 , srv1031841676:84 , srv1052866489:84 , srv1058071188:84 , srv1139401787:84 , srv1163601561:84 , srv1164424190:84 , srv1166137552:84 , srv1330177019:84 , srv1472337547:84 , srv1509107493:84 , srv1582197537:84 , srv1609460970:84 , srv1639099760:84 , srv1656618228:84 , srv1712862400:84 , srv1720149868:84 , srv1769899622:84 , srv1798485235:84 , srv1845273080:84 , srv1906685996:84 , srv1966303656:84 , srv1981823333:84 , srv2046792487:84 , srv208960005:84 , srv223243816:84 , srv255274262:84 , srv289462815:84 , srv355824064:84 , srv375542901:84 , srv398956782:84 , srv437122063:84 , srv441563680:84 , srv483409564:84 , srv537881564:84 , srv590362480:84 , srv607318591:84 , srv619971617:84 , srv698253163:84 , srv71567078:84 , srv735612714:84 , srv741489571:84 , srv823736451:84 , srv857026488:84 , srv872012070:84 , srv886180388:84 , srv891552962:84 , srv1011856946:85 , srv1086980187:85 , srv1160167527:85 , srv1281632759:85 , srv1409197288:85 , srv1440795974:85 , srv1443555281:85 , srv1504173917:85 , srv1521048815:85 , srv1615534055:85 , srv1707841578:85 , srv1749853602:85 , srv1798023996:85 , srv1868163421:85 , srv1868853876:85 , srv191074583:85 , srv1953093620:85 , srv2009145629:85 , srv201831050:85 , srv2039469328:85 , srv2090915498:85 , srv260572213:85 , srv285444720:85 , srv322715:85 , srv325672539:85 , srv330367918:85 , srv342557548:85 , srv363493963:85 , srv36761491:85 , srv410115870:85 , srv490215866:85 , srv505156222:85 , srv600312393:85 , srv610937799:85 , srv698051083:85 , srv707327247:85 , srv764521791:85 , srv766527124:85 , srv800391038:85 , srv826957056:85 , srv863450384:85 , srv902070622:85 , srv938126050:85 , srv940586170:85 , srv982545788:85 , srv990291218:85 , srv1170617532:86 , srv1959060666:86 , srv2036915981:639 }
2024-01-25 12:53:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1720149868=29, srv208960005=48, srv891552962=93, srv902070622=94, srv1164424190=8, srv1330177019=12, srv1521048815=21, srv1639099760=25, srv1052866489=2, srv1582197537=22, srv766527124=85, srv1411348428=14, srv71567078=81, srv191074583=38, srv355824064=59, srv441563680=66, srv1798023996=32, srv1163601561=7, srv1058071188=3, srv1166137552=9, srv483409564=67, srv1656618228=26, srv1981823333=42, srv1160167527=6, srv1031841676=1, srv325672539=56, srv2036915981=45, srv610937799=75, srv201831050=44, srv823736451=87, srv1409197288=13, srv260572213=52, srv1868163421=35, srv872012070=91, srv938126050=96, srv800391038=86, srv1281632759=11, srv611434414=76, srv990291218=99, srv330367918=57, srv607318591=74, srv1170617532=10, srv1440795974=16, srv1707841578=27, srv398956782=63, srv1011856946=0, srv1139401787=5, srv698051083=78, srv982545788=98, srv486668455=68, srv490215866=69, srv764521791=84, srv1509107493=20, srv2090915498=49, srv2009145629=43, srv886180388=92, srv590362480=72, srv698253163=79, srv1906685996=37, srv285444720=53, srv925944003=95, srv36761491=61, srv707327247=80, srv1472337547=18, srv1953093620=39, srv1712862400=28, srv255274262=51, srv505156222=70, srv375542901=62, srv437122063=65, srv1086980187=4, srv363493963=60, srv1845273080=34, srv741489571=83, srv600312393=73, srv322715=55, srv1966303656=41, srv2039469328=46, srv1615534055=24, srv1504173917=19, srv1959060666=40, srv1769899622=31, srv410115870=64, srv863450384=90, srv735612714=82, srv857026488=89, srv1428894170=15, srv223243816=50, srv940586170=97, srv342557548=58, srv537881564=71, srv619971617=77, srv289462815=54, srv1443555281=17, srv2046792487=47, srv1609460970=23, srv826957056=88, srv1798485235=33, srv1749853602=30, srv1868853876=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-25 12:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-25 12:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-25 12:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-25 12:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-25 12:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-25 12:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-25 12:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-25 12:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-25 12:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-25 12:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-25 12:53:15,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:15,028 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-25 12:53:15,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.421084434670241E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-25 12:53:15,305 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 395 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 3.421084434670241E-5 to a new imbalance of 8.982248280137326E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:15,306 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1058071188:83 , srv1749853602:83 , srv1959060666:83 , srv325672539:83 , srv886180388:83 , srv1011856946:84 , srv1052866489:84 , srv1086980187:84 , srv1139401787:84 , srv1160167527:84 , srv1163601561:84 , srv1164424190:84 , srv1166137552:84 , srv1170617532:84 , srv1281632759:84 , srv1330177019:84 , srv1409197288:84 , srv1411348428:84 , srv1428894170:84 , srv1440795974:84 , srv1443555281:84 , srv1472337547:84 , srv1504173917:84 , srv1509107493:84 , srv1521048815:84 , srv1582197537:84 , srv1609460970:84 , srv1615534055:84 , srv1656618228:84 , srv1707841578:84 , srv1712862400:84 , srv1720149868:84 , srv1769899622:84 , srv1798023996:84 , srv1845273080:84 , srv1868163421:84 , srv1868853876:84 , srv191074583:84 , srv1953093620:84 , srv1966303656:84 , srv1981823333:84 , srv2009145629:84 , srv201831050:84 , srv2039469328:84 , srv2046792487:84 , srv208960005:84 , srv2090915498:84 , srv223243816:84 , srv255274262:84 , srv260572213:84 , srv285444720:84 , srv289462815:84 , srv322715:84 , srv330367918:84 , srv342557548:84 , srv355824064:84 , srv363493963:84 , srv36761491:84 , srv375542901:84 , srv398956782:84 , srv410115870:84 , srv437122063:84 , srv441563680:84 , srv483409564:84 , srv486668455:84 , srv490215866:84 , srv505156222:84 , srv537881564:84 , srv590362480:84 , srv600312393:84 , srv607318591:84 , srv610937799:84 , srv611434414:84 , srv619971617:84 , srv698051083:84 , srv698253163:84 , srv707327247:84 , srv735612714:84 , srv741489571:84 , srv764521791:84 , srv766527124:84 , srv800391038:84 , srv823736451:84 , srv826957056:84 , srv857026488:84 , srv863450384:84 , srv872012070:84 , srv891552962:84 , srv902070622:84 , srv925944003:84 , srv938126050:84 , srv940586170:84 , srv982545788:84 , srv990291218:84 , srv1031841676:85 , srv1639099760:85 , srv1798485235:85 , srv1906685996:85 , srv71567078:85 , srv2036915981:684 }
2024-01-25 12:53:15,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:15,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1720149868=29, srv208960005=48, srv891552962=93, srv902070622=94, srv1164424190=8, srv1330177019=12, srv1521048815=21, srv1639099760=25, srv1052866489=2, srv1582197537=22, srv766527124=85, srv1411348428=14, srv71567078=81, srv191074583=38, srv355824064=59, srv441563680=66, srv1798023996=32, srv1163601561=7, srv1058071188=3, srv1166137552=9, srv483409564=67, srv1656618228=26, srv1981823333=42, srv1160167527=6, srv1031841676=1, srv325672539=56, srv2036915981=45, srv610937799=75, srv201831050=44, srv823736451=87, srv1409197288=13, srv260572213=52, srv1868163421=35, srv872012070=91, srv938126050=96, srv800391038=86, srv1281632759=11, srv611434414=76, srv990291218=99, srv330367918=57, srv607318591=74, srv1170617532=10, srv1440795974=16, srv1707841578=27, srv398956782=63, srv1011856946=0, srv1139401787=5, srv698051083=78, srv982545788=98, srv486668455=68, srv490215866=69, srv764521791=84, srv1509107493=20, srv2090915498=49, srv2009145629=43, srv886180388=92, srv590362480=72, srv698253163=79, srv1906685996=37, srv285444720=53, srv925944003=95, srv36761491=61, srv707327247=80, srv1472337547=18, srv1953093620=39, srv1712862400=28, srv255274262=51, srv505156222=70, srv375542901=62, srv437122063=65, srv1086980187=4, srv363493963=60, srv1845273080=34, srv741489571=83, srv600312393=73, srv322715=55, srv1966303656=41, srv2039469328=46, srv1615534055=24, srv1504173917=19, srv1959060666=40, srv1769899622=31, srv410115870=64, srv863450384=90, srv735612714=82, srv857026488=89, srv1428894170=15, srv223243816=50, srv940586170=97, srv342557548=58, srv537881564=71, srv619971617=77, srv289462815=54, srv1443555281=17, srv2046792487=47, srv1609460970=23, srv826957056=88, srv1798485235=33, srv1749853602=30, srv1868853876=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:15,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:15,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-25 12:53:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-25 12:53:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-25 12:53:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-25 12:53:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-25 12:53:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-25 12:53:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-25 12:53:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-25 12:53:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-25 12:53:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-25 12:53:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-25 12:53:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-25 12:53:15,481 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.793190239318795E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:15,482 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1058071188:83 , srv1749853602:83 , srv1959060666:83 , srv325672539:83 , srv886180388:83 , srv1011856946:84 , srv1052866489:84 , srv1086980187:84 , srv1139401787:84 , srv1160167527:84 , srv1163601561:84 , srv1164424190:84 , srv1166137552:84 , srv1170617532:84 , srv1281632759:84 , srv1330177019:84 , srv1409197288:84 , srv1411348428:84 , srv1428894170:84 , srv1440795974:84 , srv1443555281:84 , srv1472337547:84 , srv1504173917:84 , srv1509107493:84 , srv1521048815:84 , srv1582197537:84 , srv1609460970:84 , srv1615534055:84 , srv1656618228:84 , srv1707841578:84 , srv1712862400:84 , srv1720149868:84 , srv1769899622:84 , srv1798023996:84 , srv1845273080:84 , srv1868163421:84 , srv1868853876:84 , srv191074583:84 , srv1953093620:84 , srv1966303656:84 , srv1981823333:84 , srv2009145629:84 , srv201831050:84 , srv2039469328:84 , srv2046792487:84 , srv208960005:84 , srv2090915498:84 , srv223243816:84 , srv255274262:84 , srv260572213:84 , srv285444720:84 , srv289462815:84 , srv322715:84 , srv330367918:84 , srv342557548:84 , srv355824064:84 , srv363493963:84 , srv36761491:84 , srv375542901:84 , srv398956782:84 , srv410115870:84 , srv437122063:84 , srv441563680:84 , srv483409564:84 , srv486668455:84 , srv490215866:84 , srv505156222:84 , srv537881564:84 , srv590362480:84 , srv600312393:84 , srv607318591:84 , srv610937799:84 , srv611434414:84 , srv619971617:84 , srv698051083:84 , srv698253163:84 , srv707327247:84 , srv735612714:84 , srv741489571:84 , srv764521791:84 , srv766527124:84 , srv800391038:84 , srv823736451:84 , srv826957056:84 , srv857026488:84 , srv863450384:84 , srv872012070:84 , srv891552962:84 , srv902070622:84 , srv925944003:84 , srv938126050:84 , srv940586170:84 , srv982545788:84 , srv990291218:84 , srv1031841676:85 , srv1639099760:85 , srv1798485235:85 , srv1906685996:85 , srv71567078:85 , srv2036915981:684 }
2024-01-25 12:53:15,526 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=328 (was 313) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 169), AvailableMemoryMB=9216 (was 10146)
2024-01-25 12:53:15,543 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=328, ProcessCount=167, AvailableMemoryMB=9216
2024-01-25 12:53:15,544 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-25 12:53:15,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-25 12:53:15,554 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1117455779:84 , srv1133775010:84 , srv1240640644:84 , srv1253834168:84 , srv1289942070:84 , srv1414113681:84 , srv1420113419:84 , srv1434297573:84 , srv1468781924:84 , srv1483391030:84 , srv1539931614:84 , srv1568452998:84 , srv158617343:84 , srv1690284007:84 , srv1711949197:84 , srv1807208317:84 , srv1891102902:84 , srv1893854276:84 , srv2084826100:84 , srv2109685981:84 , srv218005718:84 , srv274366847:84 , srv279270262:84 , srv336266117:84 , srv455530472:84 , srv685397385:84 , srv795945212:84 , srv854098952:84 , srv957263512:84 , srv480999957:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-25 12:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1289942070=4, srv1711949197=14, srv685397385=26, srv1539931614=10, srv1483391030=9, srv1690284007=13, srv158617343=12, srv336266117=23, srv1240640644=2, srv854098952=28, srv1117455779=0, srv2084826100=18, srv1468781924=8, srv480999957=25, srv1414113681=5, srv1420113419=6, srv1891102902=16, srv1807208317=15, srv795945212=27, srv1893854276=17, srv1133775010=1, srv1253834168=3, srv279270262=22, srv1568452998=11, srv218005718=20, srv1434297573=7, srv274366847=21, srv2109685981=19, srv455530472=24, srv957263512=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:53:15,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-25 12:53:15,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0508413732679198, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:53:15,582 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912353242771326, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0508413732679198, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-25 12:55:15,572 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5853845 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912353242771326 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:55:15,580 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1117455779:90 , srv1133775010:90 , srv1240640644:90 , srv1253834168:90 , srv1289942070:90 , srv1414113681:90 , srv1420113419:90 , srv1434297573:90 , srv1468781924:90 , srv1483391030:90 , srv1539931614:90 , srv1568452998:90 , srv158617343:90 , srv1690284007:90 , srv1711949197:90 , srv1807208317:90 , srv1891102902:90 , srv1893854276:90 , srv2084826100:90 , srv2109685981:90 , srv218005718:90 , srv274366847:90 , srv279270262:90 , srv336266117:90 , srv455530472:90 , srv480999957:90 , srv685397385:90 , srv795945212:90 , srv854098952:90 , srv957263512:90 }
2024-01-25 12:55:15,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-25 12:55:15,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1289942070=4, srv1711949197=14, srv685397385=26, srv1539931614=10, srv1483391030=9, srv1690284007=13, srv158617343=12, srv336266117=23, srv1240640644=2, srv854098952=28, srv1117455779=0, srv2084826100=18, srv1468781924=8, srv480999957=25, srv1414113681=5, srv1420113419=6, srv1891102902=16, srv1807208317=15, srv795945212=27, srv1893854276=17, srv1133775010=1, srv1253834168=3, srv279270262=22, srv1568452998=11, srv218005718=20, srv1434297573=7, srv274366847=21, srv2109685981=19, srv455530472=24, srv957263512=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-25 12:55:15,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-25 12:55:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-25 12:55:15,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-25 12:55:15,608 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-25 12:55:15,609 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1117455779:90 , srv1133775010:90 , srv1240640644:90 , srv1253834168:90 , srv1289942070:90 , srv1414113681:90 , srv1420113419:90 , srv1434297573:90 , srv1468781924:90 , srv1483391030:90 , srv1539931614:90 , srv1568452998:90 , srv158617343:90 , srv1690284007:90 , srv1711949197:90 , srv1807208317:90 , srv1891102902:90 , srv1893854276:90 , srv2084826100:90 , srv2109685981:90 , srv218005718:90 , srv274366847:90 , srv279270262:90 , srv336266117:90 , srv455530472:90 , srv480999957:90 , srv685397385:90 , srv795945212:90 , srv854098952:90 , srv957263512:90 }
2024-01-25 12:55:15,630 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 328), ProcessCount=171 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=8620 (was 9216)