2023-07-24 11:53:11,007 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-24 11:53:11,313 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-24 11:53:11,430 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-24 11:53:11,499 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 11:53:11,510 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 11:53:11,525 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=423, ProcessCount=173, AvailableMemoryMB=10292
2023-07-24 11:53:11,527 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 11:53:11,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 11:53:11,659 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv102006789:84 , srv1031411843:84 , srv1045317781:84 , srv1045866766:84 , srv104953149:84 , srv1052904948:84 , srv1056701489:84 , srv1056928041:84 , srv1072325068:84 , srv107809780:84 , srv1080699476:84 , srv1140779419:84 , srv1182690232:84 , srv1184006895:84 , srv1186242485:84 , srv1191045126:84 , srv1194794274:84 , srv1212729593:84 , srv1227447447:84 , srv1286168325:84 , srv1297604320:84 , srv1312510307:84 , srv1332044312:84 , srv1357430598:84 , srv1361844137:84 , srv1398985963:84 , srv1401691575:84 , srv148970235:84 , srv1508771485:84 , srv1529442902:84 , srv155192739:84 , srv155325783:84 , srv1598077601:84 , srv163535740:84 , srv1643922186:84 , srv1681887524:84 , srv1721430120:84 , srv1723784395:84 , srv1727993898:84 , srv1728527295:84 , srv1736686894:84 , srv1738646350:84 , srv1786858413:84 , srv1805133203:84 , srv1825271778:84 , srv1866002066:84 , srv1881107768:84 , srv1919980541:84 , srv1941992746:84 , srv1955736031:84 , srv1999475135:84 , srv2029697969:84 , srv2037028574:84 , srv2046075015:84 , srv206156575:84 , srv2090280683:84 , srv2096862175:84 , srv242135685:84 , srv269827890:84 , srv2895150:84 , srv295458475:84 , srv348767833:84 , srv35775086:84 , srv365289950:84 , srv366354557:84 , srv444141290:84 , srv464014774:84 , srv464053946:84 , srv477049732:84 , srv488003373:84 , srv502656795:84 , srv504914783:84 , srv524248737:84 , srv5437021:84 , srv576767072:84 , srv588515691:84 , srv63924737:84 , srv685822688:84 , srv699760484:84 , srv703800014:84 , srv726336255:84 , srv741564495:84 , srv762020022:84 , srv791962551:84 , srv79246656:84 , srv796381951:84 , srv820387733:84 , srv824452933:84 , srv871733875:84 , srv877076377:84 , srv897040926:84 , srv916198286:84 , srv918185873:84 , srv921565738:84 , srv983862109:84 , srv985954097:84 , srv992603328:84 , srv996355185:84 , srv99800408:84 , srv1210791899:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-24 11:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv996355185=98, srv1919980541=48, srv1072325068=8, srv79246656=85, srv1045866766=3, srv576767072=75, srv983862109=95, srv2046075015=54, srv741564495=82, srv366354557=65, srv163535740=34, srv1723784395=38, srv464014774=67, srv1643922186=35, srv348767833=62, srv1941992746=49, srv1398985963=26, srv897040926=91, srv796381951=86, srv824452933=88, srv444141290=66, srv104953149=4, srv2090280683=56, srv504914783=72, srv1052904948=5, srv791962551=84, srv365289950=64, srv1727993898=39, srv1140779419=11, srv1361844137=25, srv269827890=59, srv992603328=97, srv916198286=92, srv1194794274=16, srv703800014=80, srv1999475135=51, srv102006789=0, srv1186242485=14, srv155325783=32, srv524248737=73, srv762020022=83, srv295458475=61, srv1736686894=41, srv502656795=71, srv1866002066=46, srv921565738=94, srv1184006895=13, srv1210791899=17, srv1508771485=29, srv1721430120=37, srv726336255=81, srv1227447447=19, srv242135685=58, srv918185873=93, srv1357430598=24, srv2895150=60, srv1332044312=23, srv699760484=79, srv1738646350=42, srv1286168325=20, srv1805133203=44, srv1031411843=1, srv1728527295=40, srv877076377=90, srv148970235=28, srv588515691=76, srv99800408=99, srv63924737=77, srv1598077601=33, srv1681887524=36, srv1955736031=50, srv2029697969=52, srv1045317781=2, srv1191045126=15, srv1881107768=47, srv2096862175=57, srv2037028574=53, srv1825271778=45, srv1056928041=7, srv1182690232=12, srv820387733=87, srv685822688=78, srv464053946=68, srv1080699476=10, srv1212729593=18, srv1401691575=27, srv1529442902=30, srv477049732=69, srv206156575=55, srv5437021=74, srv1297604320=21, srv35775086=63, srv488003373=70, srv871733875=89, srv155192739=31, srv107809780=9, srv985954097=96, srv1312510307=22, srv1786858413=43, srv1056701489=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 11:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 11:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 11:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 11:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 11:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 11:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 11:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 11:53:11,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 11:53:11,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 11:53:11,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 11:53:11,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 11:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 11:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 11:53:11,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 11:53:11,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 11:53:11,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 11:53:11,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:11,924 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 11:53:11,924 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 11:53:12,253 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 4665 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18554702817136787. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042632538726588856, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05714101327793139, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5183333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042632538726588856, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18058333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24966666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:12,265 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1045317781:81 , srv762020022:81 , srv1738646350:82 , srv63924737:82 , srv699760484:82 , srv1191045126:83 , srv148970235:83 , srv163535740:83 , srv1721430120:83 , srv2096862175:83 , srv488003373:83 , srv726336255:83 , srv1312510307:84 , srv1643922186:84 , srv1723784395:84 , srv1727993898:84 , srv1805133203:84 , srv444141290:84 , srv5437021:84 , srv588515691:84 , srv703800014:84 , srv79246656:84 , srv824452933:84 , srv992603328:84 , srv996355185:84 , srv104953149:85 , srv1056928041:85 , srv1194794274:85 , srv1332044312:85 , srv1357430598:85 , srv1398985963:85 , srv1999475135:85 , srv242135685:85 , srv348767833:85 , srv464014774:85 , srv502656795:85 , srv796381951:85 , srv820387733:85 , srv877076377:85 , srv921565738:85 , srv985954097:85 , srv99800408:85 , srv102006789:86 , srv1072325068:86 , srv1080699476:86 , srv1401691575:86 , srv155192739:86 , srv1598077601:86 , srv1736686894:86 , srv1786858413:86 , srv1881107768:86 , srv2090280683:86 , srv2895150:86 , srv35775086:86 , srv366354557:86 , srv464053946:86 , srv477049732:86 , srv576767072:86 , srv685822688:86 , srv791962551:86 , srv916198286:86 , srv918185873:86 , srv983862109:86 , srv107809780:87 , srv1140779419:87 , srv1184006895:87 , srv1286168325:87 , srv155325783:87 , srv1728527295:87 , srv1919980541:87 , srv2037028574:87 , srv524248737:87 , srv871733875:87 , srv897040926:87 , srv1052904948:88 , srv1056701489:88 , srv1182690232:88 , srv1297604320:88 , srv1681887524:88 , srv1825271778:88 , srv269827890:88 , srv365289950:88 , srv1045866766:89 , srv1212729593:89 , srv1227447447:89 , srv1529442902:89 , srv1866002066:89 , srv504914783:89 , srv1031411843:90 , srv1508771485:90 , srv2046075015:90 , srv206156575:90 , srv295458475:90 , srv1941992746:91 , srv2029697969:91 , srv1186242485:92 , srv741564495:92 , srv1955736031:93 , srv1361844137:95 , srv1210791899:469 }
2023-07-24 11:53:12,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:12,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv996355185=98, srv1919980541=48, srv1072325068=8, srv79246656=85, srv1045866766=3, srv576767072=75, srv983862109=95, srv2046075015=54, srv741564495=82, srv366354557=65, srv163535740=34, srv1723784395=38, srv464014774=67, srv1643922186=35, srv348767833=62, srv1941992746=49, srv1398985963=26, srv897040926=91, srv796381951=86, srv824452933=88, srv444141290=66, srv104953149=4, srv2090280683=56, srv504914783=72, srv1052904948=5, srv791962551=84, srv365289950=64, srv1727993898=39, srv1140779419=11, srv1361844137=25, srv269827890=59, srv992603328=97, srv916198286=92, srv1194794274=16, srv703800014=80, srv1999475135=51, srv102006789=0, srv1186242485=14, srv155325783=32, srv524248737=73, srv762020022=83, srv295458475=61, srv1736686894=41, srv502656795=71, srv1866002066=46, srv921565738=94, srv1184006895=13, srv1210791899=17, srv1508771485=29, srv1721430120=37, srv726336255=81, srv1227447447=19, srv242135685=58, srv918185873=93, srv1357430598=24, srv2895150=60, srv1332044312=23, srv699760484=79, srv1738646350=42, srv1286168325=20, srv1805133203=44, srv1031411843=1, srv1728527295=40, srv877076377=90, srv148970235=28, srv588515691=76, srv99800408=99, srv63924737=77, srv1598077601=33, srv1681887524=36, srv1955736031=50, srv2029697969=52, srv1045317781=2, srv1191045126=15, srv1881107768=47, srv2096862175=57, srv2037028574=53, srv1825271778=45, srv1056928041=7, srv1182690232=12, srv820387733=87, srv685822688=78, srv464053946=68, srv1080699476=10, srv1212729593=18, srv1401691575=27, srv1529442902=30, srv477049732=69, srv206156575=55, srv5437021=74, srv1297604320=21, srv35775086=63, srv488003373=70, srv871733875=89, srv155192739=31, srv107809780=9, srv985954097=96, srv1312510307=22, srv1786858413=43, srv1056701489=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 11:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 11:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 11:53:12,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 11:53:12,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 11:53:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 11:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 11:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 11:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 11:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 11:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 11:53:12,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 11:53:12,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042632538726588856, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05714101327793139, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042632538726588856, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18058333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24966666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:12,441 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 11:53:12,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18551436314320421, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042632538726588856, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05714101327793139, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042632538726588856, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18058333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24966666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 11:53:12,765 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 445 ms to try 5000 different iterations.  Found a solution that moves 2693 regions; Going from a computed imbalance of 0.18551436314320421 to a new imbalance of 0.015199705157555532. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02351036471502612); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03399676488206913, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2992222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02351036471502612); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:12,777 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1361844137:75 , srv741564495:78 , srv1955736031:79 , srv1186242485:80 , srv206156575:80 , srv1045866766:81 , srv2029697969:81 , srv504914783:81 , srv1297604320:82 , srv1508771485:82 , srv155325783:82 , srv1866002066:82 , srv1941992746:82 , srv2046075015:82 , srv1031411843:83 , srv1052904948:83 , srv1056701489:83 , srv1182690232:83 , srv1227447447:83 , srv1681887524:83 , srv1919980541:83 , srv102006789:84 , srv1212729593:84 , srv1401691575:84 , srv1529442902:84 , srv1728527295:84 , srv1786858413:84 , srv269827890:84 , srv524248737:84 , srv871733875:84 , srv107809780:85 , srv1140779419:85 , srv1184006895:85 , srv1194794274:85 , srv1999475135:85 , srv2090280683:85 , srv2895150:85 , srv295458475:85 , srv35775086:85 , srv365289950:85 , srv366354557:85 , srv576767072:85 , srv796381951:85 , srv897040926:85 , srv104953149:86 , srv155192739:86 , srv1598077601:86 , srv1825271778:86 , srv464053946:86 , srv5437021:86 , srv791962551:86 , srv820387733:86 , srv916198286:86 , srv918185873:86 , srv983862109:86 , srv996355185:86 , srv99800408:86 , srv1056928041:87 , srv1080699476:87 , srv1286168325:87 , srv1332044312:87 , srv1398985963:87 , srv1736686894:87 , srv1805133203:87 , srv348767833:87 , srv477049732:87 , srv488003373:87 , srv502656795:87 , srv921565738:87 , srv1191045126:88 , srv148970235:88 , srv1643922186:88 , srv1723784395:88 , srv1881107768:88 , srv2037028574:88 , srv2096862175:88 , srv242135685:88 , srv444141290:88 , srv464014774:88 , srv63924737:88 , srv685822688:88 , srv877076377:88 , srv1045317781:89 , srv1072325068:89 , srv163535740:89 , srv1727993898:89 , srv1738646350:89 , srv588515691:89 , srv703800014:89 , srv726336255:89 , srv985954097:89 , srv992603328:89 , srv79246656:90 , srv824452933:90 , srv1312510307:91 , srv1357430598:91 , srv1721430120:91 , srv699760484:91 , srv762020022:92 , srv1210791899:514 }
2023-07-24 11:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv996355185=98, srv1919980541=48, srv1072325068=8, srv79246656=85, srv1045866766=3, srv576767072=75, srv983862109=95, srv2046075015=54, srv741564495=82, srv366354557=65, srv163535740=34, srv1723784395=38, srv464014774=67, srv1643922186=35, srv348767833=62, srv1941992746=49, srv1398985963=26, srv897040926=91, srv796381951=86, srv824452933=88, srv444141290=66, srv104953149=4, srv2090280683=56, srv504914783=72, srv1052904948=5, srv791962551=84, srv365289950=64, srv1727993898=39, srv1140779419=11, srv1361844137=25, srv269827890=59, srv992603328=97, srv916198286=92, srv1194794274=16, srv703800014=80, srv1999475135=51, srv102006789=0, srv1186242485=14, srv155325783=32, srv524248737=73, srv762020022=83, srv295458475=61, srv1736686894=41, srv502656795=71, srv1866002066=46, srv921565738=94, srv1184006895=13, srv1210791899=17, srv1508771485=29, srv1721430120=37, srv726336255=81, srv1227447447=19, srv242135685=58, srv918185873=93, srv1357430598=24, srv2895150=60, srv1332044312=23, srv699760484=79, srv1738646350=42, srv1286168325=20, srv1805133203=44, srv1031411843=1, srv1728527295=40, srv877076377=90, srv148970235=28, srv588515691=76, srv99800408=99, srv63924737=77, srv1598077601=33, srv1681887524=36, srv1955736031=50, srv2029697969=52, srv1045317781=2, srv1191045126=15, srv1881107768=47, srv2096862175=57, srv2037028574=53, srv1825271778=45, srv1056928041=7, srv1182690232=12, srv820387733=87, srv685822688=78, srv464053946=68, srv1080699476=10, srv1212729593=18, srv1401691575=27, srv1529442902=30, srv477049732=69, srv206156575=55, srv5437021=74, srv1297604320=21, srv35775086=63, srv488003373=70, srv871733875=89, srv155192739=31, srv107809780=9, srv985954097=96, srv1312510307=22, srv1786858413=43, srv1056701489=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:12,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:12,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:12,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:12,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 11:53:12,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 11:53:12,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 11:53:12,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 11:53:12,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 11:53:12,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 11:53:12,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 11:53:12,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 11:53:12,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 11:53:12,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02351036471502612); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03399676488206913, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02351036471502612); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:12,978 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 11:53:12,978 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015180848368521299, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02351036471502612); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03399676488206913, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02351036471502612); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 11:53:13,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 1010 regions; Going from a computed imbalance of 0.015180848368521299 to a new imbalance of 0.0012126219080613619. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006662924501529447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00735503370238284); MoveCostFunction : (multiplier=7.0, imbalance=0.11222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006662924501529447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:13,346 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1072325068:82 , srv1312510307:82 , srv2037028574:82 , srv985954097:82 , srv1357430598:83 , srv1721430120:83 , srv1881107768:83 , srv295458475:83 , srv685822688:83 , srv824452933:83 , srv1031411843:84 , srv1080699476:84 , srv1286168325:84 , srv1529442902:84 , srv1736686894:84 , srv1941992746:84 , srv464014774:84 , srv477049732:84 , srv699760484:84 , srv79246656:84 , srv877076377:84 , srv992603328:84 , srv1056701489:85 , srv107809780:85 , srv1184006895:85 , srv1186242485:85 , srv1212729593:85 , srv1227447447:85 , srv1398985963:85 , srv155192739:85 , srv1598077601:85 , srv163535740:85 , srv1723784395:85 , srv1727993898:85 , srv1825271778:85 , srv2029697969:85 , srv242135685:85 , srv348767833:85 , srv365289950:85 , srv444141290:85 , srv464053946:85 , srv502656795:85 , srv588515691:85 , srv762020022:85 , srv791962551:85 , srv916198286:85 , srv918185873:85 , srv104953149:86 , srv1056928041:86 , srv1140779419:86 , srv1182690232:86 , srv1332044312:86 , srv148970235:86 , srv1508771485:86 , srv1643922186:86 , srv1738646350:86 , srv1805133203:86 , srv1866002066:86 , srv2046075015:86 , srv2096862175:86 , srv269827890:86 , srv2895150:86 , srv366354557:86 , srv504914783:86 , srv524248737:86 , srv703800014:86 , srv726336255:86 , srv871733875:86 , srv921565738:86 , srv983862109:86 , srv102006789:87 , srv1045317781:87 , srv1045866766:87 , srv1052904948:87 , srv1191045126:87 , srv1194794274:87 , srv1297604320:87 , srv1361844137:87 , srv1401691575:87 , srv1681887524:87 , srv1728527295:87 , srv1786858413:87 , srv1919980541:87 , srv2090280683:87 , srv35775086:87 , srv488003373:87 , srv5437021:87 , srv576767072:87 , srv63924737:87 , srv796381951:87 , srv820387733:87 , srv897040926:87 , srv99800408:87 , srv155325783:88 , srv1955736031:88 , srv1999475135:88 , srv206156575:88 , srv741564495:88 , srv996355185:88 , srv1210791899:534 }
2023-07-24 11:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv996355185=98, srv1919980541=48, srv1072325068=8, srv79246656=85, srv1045866766=3, srv576767072=75, srv983862109=95, srv2046075015=54, srv741564495=82, srv366354557=65, srv163535740=34, srv1723784395=38, srv464014774=67, srv1643922186=35, srv348767833=62, srv1941992746=49, srv1398985963=26, srv897040926=91, srv796381951=86, srv824452933=88, srv444141290=66, srv104953149=4, srv2090280683=56, srv504914783=72, srv1052904948=5, srv791962551=84, srv365289950=64, srv1727993898=39, srv1140779419=11, srv1361844137=25, srv269827890=59, srv992603328=97, srv916198286=92, srv1194794274=16, srv703800014=80, srv1999475135=51, srv102006789=0, srv1186242485=14, srv155325783=32, srv524248737=73, srv762020022=83, srv295458475=61, srv1736686894=41, srv502656795=71, srv1866002066=46, srv921565738=94, srv1184006895=13, srv1210791899=17, srv1508771485=29, srv1721430120=37, srv726336255=81, srv1227447447=19, srv242135685=58, srv918185873=93, srv1357430598=24, srv2895150=60, srv1332044312=23, srv699760484=79, srv1738646350=42, srv1286168325=20, srv1805133203=44, srv1031411843=1, srv1728527295=40, srv877076377=90, srv148970235=28, srv588515691=76, srv99800408=99, srv63924737=77, srv1598077601=33, srv1681887524=36, srv1955736031=50, srv2029697969=52, srv1045317781=2, srv1191045126=15, srv1881107768=47, srv2096862175=57, srv2037028574=53, srv1825271778=45, srv1056928041=7, srv1182690232=12, srv820387733=87, srv685822688=78, srv464053946=68, srv1080699476=10, srv1212729593=18, srv1401691575=27, srv1529442902=30, srv477049732=69, srv206156575=55, srv5437021=74, srv1297604320=21, srv35775086=63, srv488003373=70, srv871733875=89, srv155192739=31, srv107809780=9, srv985954097=96, srv1312510307=22, srv1786858413=43, srv1056701489=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 11:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 11:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 11:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 11:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 11:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 11:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 11:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 11:53:13,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 11:53:13,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 11:53:13,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 11:53:13,516 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006662924501529447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00735503370238284); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006662924501529447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:13,516 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 11:53:13,517 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0012055497369048169, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006662924501529447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00735503370238284); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006662924501529447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 11:53:13,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 424 ms to try 5000 different iterations.  Found a solution that moves 266 regions; Going from a computed imbalance of 0.0012055497369048169 to a new imbalance of 5.671725426957355E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.029555555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:13,837 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1955736031:82 , srv1357430598:83 , srv1825271778:83 , srv703800014:83 , srv79246656:83 , srv1052904948:84 , srv1056928041:84 , srv1140779419:84 , srv1191045126:84 , srv1212729593:84 , srv1286168325:84 , srv1643922186:84 , srv1681887524:84 , srv2046075015:84 , srv206156575:84 , srv2090280683:84 , srv2096862175:84 , srv242135685:84 , srv269827890:84 , srv295458475:84 , srv35775086:84 , srv365289950:84 , srv366354557:84 , srv477049732:84 , srv524248737:84 , srv576767072:84 , srv588515691:84 , srv63924737:84 , srv726336255:84 , srv741564495:84 , srv820387733:84 , srv897040926:84 , srv918185873:84 , srv921565738:84 , srv983862109:84 , srv992603328:84 , srv996355185:84 , srv99800408:84 , srv102006789:85 , srv1031411843:85 , srv1045317781:85 , srv1045866766:85 , srv104953149:85 , srv1072325068:85 , srv107809780:85 , srv1080699476:85 , srv1182690232:85 , srv1184006895:85 , srv1186242485:85 , srv1194794274:85 , srv1227447447:85 , srv1297604320:85 , srv1312510307:85 , srv1332044312:85 , srv1361844137:85 , srv1398985963:85 , srv1401691575:85 , srv148970235:85 , srv1508771485:85 , srv1529442902:85 , srv155192739:85 , srv155325783:85 , srv1598077601:85 , srv163535740:85 , srv1721430120:85 , srv1723784395:85 , srv1727993898:85 , srv1728527295:85 , srv1736686894:85 , srv1738646350:85 , srv1786858413:85 , srv1805133203:85 , srv1866002066:85 , srv1881107768:85 , srv1919980541:85 , srv1941992746:85 , srv1999475135:85 , srv2029697969:85 , srv2037028574:85 , srv2895150:85 , srv348767833:85 , srv444141290:85 , srv464014774:85 , srv464053946:85 , srv488003373:85 , srv502656795:85 , srv5437021:85 , srv685822688:85 , srv699760484:85 , srv762020022:85 , srv791962551:85 , srv796381951:85 , srv824452933:85 , srv871733875:85 , srv916198286:85 , srv1056701489:86 , srv504914783:86 , srv877076377:86 , srv985954097:86 , srv1210791899:625 }
2023-07-24 11:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv996355185=98, srv1919980541=48, srv1072325068=8, srv79246656=85, srv1045866766=3, srv576767072=75, srv983862109=95, srv2046075015=54, srv741564495=82, srv366354557=65, srv163535740=34, srv1723784395=38, srv464014774=67, srv1643922186=35, srv348767833=62, srv1941992746=49, srv1398985963=26, srv897040926=91, srv796381951=86, srv824452933=88, srv444141290=66, srv104953149=4, srv2090280683=56, srv504914783=72, srv1052904948=5, srv791962551=84, srv365289950=64, srv1727993898=39, srv1140779419=11, srv1361844137=25, srv269827890=59, srv992603328=97, srv916198286=92, srv1194794274=16, srv703800014=80, srv1999475135=51, srv102006789=0, srv1186242485=14, srv155325783=32, srv524248737=73, srv762020022=83, srv295458475=61, srv1736686894=41, srv502656795=71, srv1866002066=46, srv921565738=94, srv1184006895=13, srv1210791899=17, srv1508771485=29, srv1721430120=37, srv726336255=81, srv1227447447=19, srv242135685=58, srv918185873=93, srv1357430598=24, srv2895150=60, srv1332044312=23, srv699760484=79, srv1738646350=42, srv1286168325=20, srv1805133203=44, srv1031411843=1, srv1728527295=40, srv877076377=90, srv148970235=28, srv588515691=76, srv99800408=99, srv63924737=77, srv1598077601=33, srv1681887524=36, srv1955736031=50, srv2029697969=52, srv1045317781=2, srv1191045126=15, srv1881107768=47, srv2096862175=57, srv2037028574=53, srv1825271778=45, srv1056928041=7, srv1182690232=12, srv820387733=87, srv685822688=78, srv464053946=68, srv1080699476=10, srv1212729593=18, srv1401691575=27, srv1529442902=30, srv477049732=69, srv206156575=55, srv5437021=74, srv1297604320=21, srv35775086=63, srv488003373=70, srv871733875=89, srv155192739=31, srv107809780=9, srv985954097=96, srv1312510307=22, srv1786858413=43, srv1056701489=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 11:53:13,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 11:53:13,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 11:53:13,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 11:53:13,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 11:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 11:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 11:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 11:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 11:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 11:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 11:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 11:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 11:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 11:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 11:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 11:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 11:53:13,988 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:13,988 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 11:53:13,988 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.485468246002802E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 11:53:14,280 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 395 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 5.485468246002802E-5 to a new imbalance of 6.594045862748175E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:14,281 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1332044312:83 , srv1508771485:83 , srv1727993898:83 , srv1728527295:83 , srv1999475135:83 , srv762020022:83 , srv877076377:83 , srv897040926:83 , srv102006789:84 , srv1031411843:84 , srv1045317781:84 , srv1045866766:84 , srv104953149:84 , srv1052904948:84 , srv1056701489:84 , srv1056928041:84 , srv1072325068:84 , srv107809780:84 , srv1080699476:84 , srv1140779419:84 , srv1182690232:84 , srv1184006895:84 , srv1186242485:84 , srv1191045126:84 , srv1194794274:84 , srv1212729593:84 , srv1227447447:84 , srv1286168325:84 , srv1297604320:84 , srv1312510307:84 , srv1357430598:84 , srv1361844137:84 , srv1398985963:84 , srv1401691575:84 , srv148970235:84 , srv1529442902:84 , srv155192739:84 , srv155325783:84 , srv1598077601:84 , srv163535740:84 , srv1643922186:84 , srv1681887524:84 , srv1721430120:84 , srv1723784395:84 , srv1736686894:84 , srv1738646350:84 , srv1786858413:84 , srv1805133203:84 , srv1825271778:84 , srv1866002066:84 , srv1881107768:84 , srv1919980541:84 , srv1941992746:84 , srv1955736031:84 , srv2029697969:84 , srv2037028574:84 , srv2046075015:84 , srv206156575:84 , srv2090280683:84 , srv242135685:84 , srv269827890:84 , srv2895150:84 , srv295458475:84 , srv348767833:84 , srv35775086:84 , srv365289950:84 , srv444141290:84 , srv464014774:84 , srv464053946:84 , srv488003373:84 , srv502656795:84 , srv504914783:84 , srv5437021:84 , srv576767072:84 , srv588515691:84 , srv685822688:84 , srv699760484:84 , srv703800014:84 , srv726336255:84 , srv741564495:84 , srv791962551:84 , srv796381951:84 , srv820387733:84 , srv824452933:84 , srv871733875:84 , srv916198286:84 , srv921565738:84 , srv983862109:84 , srv985954097:84 , srv996355185:84 , srv99800408:84 , srv2096862175:85 , srv366354557:85 , srv477049732:85 , srv524248737:85 , srv63924737:85 , srv79246656:85 , srv918185873:85 , srv992603328:85 , srv1210791899:684 }
2023-07-24 11:53:14,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:14,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv996355185=98, srv1919980541=48, srv1072325068=8, srv79246656=85, srv1045866766=3, srv576767072=75, srv983862109=95, srv2046075015=54, srv741564495=82, srv366354557=65, srv163535740=34, srv1723784395=38, srv464014774=67, srv1643922186=35, srv348767833=62, srv1941992746=49, srv1398985963=26, srv897040926=91, srv796381951=86, srv824452933=88, srv444141290=66, srv104953149=4, srv2090280683=56, srv504914783=72, srv1052904948=5, srv791962551=84, srv365289950=64, srv1727993898=39, srv1140779419=11, srv1361844137=25, srv269827890=59, srv992603328=97, srv916198286=92, srv1194794274=16, srv703800014=80, srv1999475135=51, srv102006789=0, srv1186242485=14, srv155325783=32, srv524248737=73, srv762020022=83, srv295458475=61, srv1736686894=41, srv502656795=71, srv1866002066=46, srv921565738=94, srv1184006895=13, srv1210791899=17, srv1508771485=29, srv1721430120=37, srv726336255=81, srv1227447447=19, srv242135685=58, srv918185873=93, srv1357430598=24, srv2895150=60, srv1332044312=23, srv699760484=79, srv1738646350=42, srv1286168325=20, srv1805133203=44, srv1031411843=1, srv1728527295=40, srv877076377=90, srv148970235=28, srv588515691=76, srv99800408=99, srv63924737=77, srv1598077601=33, srv1681887524=36, srv1955736031=50, srv2029697969=52, srv1045317781=2, srv1191045126=15, srv1881107768=47, srv2096862175=57, srv2037028574=53, srv1825271778=45, srv1056928041=7, srv1182690232=12, srv820387733=87, srv685822688=78, srv464053946=68, srv1080699476=10, srv1212729593=18, srv1401691575=27, srv1529442902=30, srv477049732=69, srv206156575=55, srv5437021=74, srv1297604320=21, srv35775086=63, srv488003373=70, srv871733875=89, srv155192739=31, srv107809780=9, srv985954097=96, srv1312510307=22, srv1786858413=43, srv1056701489=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:14,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:14,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:14,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:14,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:14,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:14,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:14,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:14,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:14,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:14,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:14,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:14,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 11:53:14,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 11:53:14,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 11:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 11:53:14,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 11:53:14,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 11:53:14,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 11:53:14,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 11:53:14,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 11:53:14,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:14,426 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1332044312:83 , srv1508771485:83 , srv1727993898:83 , srv1728527295:83 , srv1999475135:83 , srv762020022:83 , srv877076377:83 , srv897040926:83 , srv102006789:84 , srv1031411843:84 , srv1045317781:84 , srv1045866766:84 , srv104953149:84 , srv1052904948:84 , srv1056701489:84 , srv1056928041:84 , srv1072325068:84 , srv107809780:84 , srv1080699476:84 , srv1140779419:84 , srv1182690232:84 , srv1184006895:84 , srv1186242485:84 , srv1191045126:84 , srv1194794274:84 , srv1212729593:84 , srv1227447447:84 , srv1286168325:84 , srv1297604320:84 , srv1312510307:84 , srv1357430598:84 , srv1361844137:84 , srv1398985963:84 , srv1401691575:84 , srv148970235:84 , srv1529442902:84 , srv155192739:84 , srv155325783:84 , srv1598077601:84 , srv163535740:84 , srv1643922186:84 , srv1681887524:84 , srv1721430120:84 , srv1723784395:84 , srv1736686894:84 , srv1738646350:84 , srv1786858413:84 , srv1805133203:84 , srv1825271778:84 , srv1866002066:84 , srv1881107768:84 , srv1919980541:84 , srv1941992746:84 , srv1955736031:84 , srv2029697969:84 , srv2037028574:84 , srv2046075015:84 , srv206156575:84 , srv2090280683:84 , srv242135685:84 , srv269827890:84 , srv2895150:84 , srv295458475:84 , srv348767833:84 , srv35775086:84 , srv365289950:84 , srv444141290:84 , srv464014774:84 , srv464053946:84 , srv488003373:84 , srv502656795:84 , srv504914783:84 , srv5437021:84 , srv576767072:84 , srv588515691:84 , srv685822688:84 , srv699760484:84 , srv703800014:84 , srv726336255:84 , srv741564495:84 , srv791962551:84 , srv796381951:84 , srv820387733:84 , srv824452933:84 , srv871733875:84 , srv916198286:84 , srv921565738:84 , srv983862109:84 , srv985954097:84 , srv996355185:84 , srv99800408:84 , srv2096862175:85 , srv366354557:85 , srv477049732:85 , srv524248737:85 , srv63924737:85 , srv79246656:85 , srv918185873:85 , srv992603328:85 , srv1210791899:684 }
2023-07-24 11:53:14,455 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=423 (was 423), ProcessCount=173 (was 173), AvailableMemoryMB=9437 (was 10292)
2023-07-24 11:53:14,468 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=423, ProcessCount=173, AvailableMemoryMB=9437
2023-07-24 11:53:14,468 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 11:53:14,469 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-24 11:53:14,484 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1198234522:84 , srv1246452622:84 , srv1250190463:84 , srv1266677630:84 , srv1283813562:84 , srv1409105060:84 , srv1449797068:84 , srv1508766673:84 , srv1547926373:84 , srv155644911:84 , srv1559811606:84 , srv1709447774:84 , srv1818171733:84 , srv265685909:84 , srv366406580:84 , srv376643581:84 , srv41700198:84 , srv459259439:84 , srv46346329:84 , srv514737404:84 , srv658912990:84 , srv674514289:84 , srv678772718:84 , srv728267937:84 , srv730225694:84 , srv79316713:84 , srv828859166:84 , srv833353832:84 , srv895232509:84 , srv1642933817:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-24 11:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1642933817=11, srv658912990=21, srv1508766673=7, srv1246452622=1, srv265685909=14, srv46346329=19, srv674514289=22, srv459259439=18, srv730225694=25, srv833353832=28, srv728267937=24, srv828859166=27, srv366406580=15, srv155644911=9, srv79316713=26, srv678772718=23, srv1818171733=13, srv1283813562=4, srv1266677630=3, srv1709447774=12, srv1250190463=2, srv1449797068=6, srv41700198=17, srv514737404=20, srv1559811606=10, srv895232509=29, srv376643581=16, srv1409105060=5, srv1198234522=0, srv1547926373=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 11:53:14,529 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1263739532456363, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:53:14,530 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912591243464467, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1263739532456363, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-24 11:55:14,505 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6091267 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.9912591243464467 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:55:14,514 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1198234522:90 , srv1246452622:90 , srv1250190463:90 , srv1266677630:90 , srv1283813562:90 , srv1409105060:90 , srv1449797068:90 , srv1508766673:90 , srv1547926373:90 , srv155644911:90 , srv1559811606:90 , srv1642933817:90 , srv1709447774:90 , srv1818171733:90 , srv265685909:90 , srv366406580:90 , srv376643581:90 , srv41700198:90 , srv459259439:90 , srv46346329:90 , srv514737404:90 , srv658912990:90 , srv674514289:90 , srv678772718:90 , srv728267937:90 , srv730225694:90 , srv79316713:90 , srv828859166:90 , srv833353832:90 , srv895232509:90 }
2023-07-24 11:55:14,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 11:55:14,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1642933817=11, srv658912990=21, srv1508766673=7, srv1246452622=1, srv265685909=14, srv46346329=19, srv674514289=22, srv459259439=18, srv730225694=25, srv833353832=28, srv728267937=24, srv828859166=27, srv366406580=15, srv155644911=9, srv79316713=26, srv678772718=23, srv1818171733=13, srv1283813562=4, srv1266677630=3, srv1709447774=12, srv1250190463=2, srv1449797068=6, srv41700198=17, srv514737404=20, srv1559811606=10, srv895232509=29, srv376643581=16, srv1409105060=5, srv1198234522=0, srv1547926373=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 11:55:14,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 11:55:14,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 11:55:14,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 11:55:14,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 11:55:14,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 11:55:14,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 11:55:14,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 11:55:14,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 11:55:14,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 11:55:14,537 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1198234522:90 , srv1246452622:90 , srv1250190463:90 , srv1266677630:90 , srv1283813562:90 , srv1409105060:90 , srv1449797068:90 , srv1508766673:90 , srv1547926373:90 , srv155644911:90 , srv1559811606:90 , srv1642933817:90 , srv1709447774:90 , srv1818171733:90 , srv265685909:90 , srv366406580:90 , srv376643581:90 , srv41700198:90 , srv459259439:90 , srv46346329:90 , srv514737404:90 , srv658912990:90 , srv674514289:90 , srv678772718:90 , srv728267937:90 , srv730225694:90 , srv79316713:90 , srv828859166:90 , srv833353832:90 , srv895232509:90 }
2023-07-24 11:55:14,550 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 423), ProcessCount=173 (was 173), AvailableMemoryMB=9710 (was 9437) - AvailableMemoryMB LEAK? -