2023-11-03 18:58:05,502 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-03 18:58:05,742 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-03 18:58:05,833 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-03 18:58:05,894 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-03 18:58:05,900 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-03 18:58:05,911 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=167, AvailableMemoryMB=10058
2023-11-03 18:58:05,914 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-03 18:58:05,914 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-03 18:58:06,029 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001365100:84 , srv1015573215:84 , srv1030241346:84 , srv1042173424:84 , srv1057022946:84 , srv105860932:84 , srv1066290082:84 , srv1074612860:84 , srv1077657349:84 , srv1099656931:84 , srv1115657303:84 , srv1130907080:84 , srv1132668976:84 , srv1133604459:84 , srv1150205551:84 , srv1184572145:84 , srv1224842154:84 , srv1240443463:84 , srv1264291604:84 , srv1270581221:84 , srv1303107811:84 , srv1338693249:84 , srv1359039582:84 , srv1374673826:84 , srv1376455142:84 , srv1383972878:84 , srv1387317581:84 , srv1391855685:84 , srv139380133:84 , srv140165001:84 , srv1410860130:84 , srv1436066061:84 , srv1466014896:84 , srv1584706949:84 , srv1586875409:84 , srv1617709878:84 , srv1632889483:84 , srv1661218241:84 , srv1671722915:84 , srv1710449845:84 , srv1775464074:84 , srv1796329898:84 , srv1805032473:84 , srv1805273182:84 , srv1816293264:84 , srv1817933515:84 , srv1864584672:84 , srv1894634998:84 , srv1910281071:84 , srv1914394489:84 , srv1921468612:84 , srv1949205619:84 , srv1996707325:84 , srv2002409210:84 , srv2015374266:84 , srv2038435652:84 , srv2045378372:84 , srv2057910081:84 , srv2068832214:84 , srv2095588185:84 , srv2134303480:84 , srv214964754:84 , srv224154618:84 , srv245261828:84 , srv253608899:84 , srv255718157:84 , srv294759853:84 , srv304911926:84 , srv33278753:84 , srv357905825:84 , srv360954489:84 , srv397491700:84 , srv398720163:84 , srv399272342:84 , srv412329010:84 , srv436464841:84 , srv460081448:84 , srv515815107:84 , srv520327483:84 , srv522564997:84 , srv532640527:84 , srv537162215:84 , srv554393544:84 , srv557534720:84 , srv598959397:84 , srv610910133:84 , srv616852558:84 , srv704914554:84 , srv723146057:84 , srv746638883:84 , srv79427703:84 , srv804218838:84 , srv809081263:84 , srv827081982:84 , srv871691532:84 , srv895030035:84 , srv910590724:84 , srv92628264:84 , srv965134004:84 , srv830660428:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-03 18:58:06,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:06,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1817933515=45, srv1584706949=33, srv1661218241=37, srv871691532=95, srv554393544=82, srv616852558=86, srv224154618=62, srv809081263=92, srv2057910081=57, srv537162215=81, srv704914554=87, srv1224842154=16, srv1466014896=32, srv965134004=99, srv827081982=93, srv253608899=64, srv895030035=96, srv1066290082=6, srv140165001=29, srv2134303480=60, srv255718157=65, srv1132668976=12, srv1270581221=19, srv1015573215=1, srv1816293264=44, srv1383972878=25, srv1150205551=14, srv1359039582=22, srv2002409210=53, srv92628264=98, srv1387317581=26, srv1240443463=17, srv1949205619=51, srv1374673826=23, srv436464841=75, srv1586875409=34, srv460081448=76, srv1775464074=40, srv1042173424=3, srv245261828=63, srv1410860130=30, srv294759853=66, srv2068832214=58, srv1074612860=7, srv610910133=85, srv399272342=73, srv830660428=94, srv2038435652=55, srv1710449845=39, srv910590724=97, srv1894634998=47, srv398720163=72, srv412329010=74, srv79427703=90, srv1130907080=11, srv304911926=67, srv1077657349=8, srv1617709878=35, srv532640527=80, srv1391855685=27, srv2095588185=59, srv515815107=77, srv1057022946=4, srv105860932=5, srv598959397=84, srv1632889483=36, srv1796329898=41, srv2045378372=56, srv1133604459=13, srv1671722915=38, srv1001365100=0, srv723146057=88, srv2015374266=54, srv1099656931=9, srv1436066061=31, srv557534720=83, srv1338693249=21, srv1030241346=2, srv357905825=69, srv1910281071=48, srv1996707325=52, srv1376455142=24, srv33278753=68, srv397491700=71, srv746638883=89, srv1864584672=46, srv1264291604=18, srv804218838=91, srv1805032473=42, srv360954489=70, srv1115657303=10, srv520327483=78, srv1914394489=49, srv1184572145=15, srv139380133=28, srv214964754=61, srv1921468612=50, srv1303107811=20, srv1805273182=43, srv522564997=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:06,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:06,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:06,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:06,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:06,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:06,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:06,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:06,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:06,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:06,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:06,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:06,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:06,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:06,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:06,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:06,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:06,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:06,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:06,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:06,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:06,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:06,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:06,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:06,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:06,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-03 18:58:06,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-03 18:58:06,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-03 18:58:06,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-03 18:58:06,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-03 18:58:06,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-03 18:58:06,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-03 18:58:06,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-03 18:58:06,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-03 18:58:06,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-03 18:58:06,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-03 18:58:06,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-03 18:58:06,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-03 18:58:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-03 18:58:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-03 18:58:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-03 18:58:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-03 18:58:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-03 18:58:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-03 18:58:06,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-03 18:58:06,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-03 18:58:06,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-03 18:58:06,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-03 18:58:06,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-03 18:58:06,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-03 18:58:06,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-03 18:58:06,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-03 18:58:06,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-03 18:58:06,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-03 18:58:06,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-03 18:58:06,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-03 18:58:06,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-03 18:58:06,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-03 18:58:06,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-03 18:58:06,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-03 18:58:06,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-03 18:58:06,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-03 18:58:06,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-03 18:58:06,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-03 18:58:06,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-03 18:58:06,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:06,362 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-03 18:58:06,362 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-03 18:58:06,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 598 ms to try 5000 different iterations.  Found a solution that moves 4694 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18094829639575957. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041064219321598344, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06048067838502192, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5215555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041064219321598344, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24183333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:06,773 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv105860932:82 , srv1132668976:82 , srv1894634998:82 , srv746638883:82 , srv1099656931:83 , srv1710449845:83 , srv1996707325:83 , srv294759853:83 , srv304911926:83 , srv33278753:83 , srv398720163:83 , srv522564997:83 , srv598959397:83 , srv1077657349:84 , srv1133604459:84 , srv1270581221:84 , srv1374673826:84 , srv1632889483:84 , srv1796329898:84 , srv2002409210:84 , srv2095588185:84 , srv253608899:84 , srv704914554:84 , srv1042173424:85 , srv1066290082:85 , srv1376455142:85 , srv1383972878:85 , srv1410860130:85 , srv1584706949:85 , srv1617709878:85 , srv1805273182:85 , srv1864584672:85 , srv2045378372:85 , srv2134303480:85 , srv399272342:85 , srv460081448:85 , srv532640527:85 , srv723146057:85 , srv965134004:85 , srv1030241346:86 , srv1130907080:86 , srv1303107811:86 , srv1338693249:86 , srv1391855685:86 , srv140165001:86 , srv1805032473:86 , srv1816293264:86 , srv1817933515:86 , srv2068832214:86 , srv255718157:86 , srv357905825:86 , srv360954489:86 , srv520327483:86 , srv554393544:86 , srv557534720:86 , srv804218838:86 , srv809081263:86 , srv895030035:86 , srv1015573215:87 , srv1074612860:87 , srv1184572145:87 , srv1224842154:87 , srv1387317581:87 , srv1436066061:87 , srv1661218241:87 , srv1671722915:87 , srv1775464074:87 , srv1910281071:87 , srv1949205619:87 , srv2038435652:87 , srv537162215:87 , srv616852558:87 , srv871691532:87 , srv910590724:87 , srv92628264:87 , srv1001365100:88 , srv1115657303:88 , srv1921468612:88 , srv397491700:88 , srv610910133:88 , srv79427703:88 , srv827081982:88 , srv1057022946:89 , srv1240443463:89 , srv214964754:89 , srv245261828:89 , srv1150205551:90 , srv1359039582:90 , srv139380133:90 , srv1586875409:90 , srv2015374266:90 , srv2057910081:90 , srv412329010:90 , srv1264291604:91 , srv224154618:91 , srv1914394489:92 , srv436464841:92 , srv1466014896:94 , srv515815107:95 , srv830660428:455 }
2023-11-03 18:58:06,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:06,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1817933515=45, srv1584706949=33, srv1661218241=37, srv871691532=95, srv554393544=82, srv616852558=86, srv224154618=62, srv809081263=92, srv2057910081=57, srv537162215=81, srv704914554=87, srv1224842154=16, srv1466014896=32, srv965134004=99, srv827081982=93, srv253608899=64, srv895030035=96, srv1066290082=6, srv140165001=29, srv2134303480=60, srv255718157=65, srv1132668976=12, srv1270581221=19, srv1015573215=1, srv1816293264=44, srv1383972878=25, srv1150205551=14, srv1359039582=22, srv2002409210=53, srv92628264=98, srv1387317581=26, srv1240443463=17, srv1949205619=51, srv1374673826=23, srv436464841=75, srv1586875409=34, srv460081448=76, srv1775464074=40, srv1042173424=3, srv245261828=63, srv1410860130=30, srv294759853=66, srv2068832214=58, srv1074612860=7, srv610910133=85, srv399272342=73, srv830660428=94, srv2038435652=55, srv1710449845=39, srv910590724=97, srv1894634998=47, srv398720163=72, srv412329010=74, srv79427703=90, srv1130907080=11, srv304911926=67, srv1077657349=8, srv1617709878=35, srv532640527=80, srv1391855685=27, srv2095588185=59, srv515815107=77, srv1057022946=4, srv105860932=5, srv598959397=84, srv1632889483=36, srv1796329898=41, srv2045378372=56, srv1133604459=13, srv1671722915=38, srv1001365100=0, srv723146057=88, srv2015374266=54, srv1099656931=9, srv1436066061=31, srv557534720=83, srv1338693249=21, srv1030241346=2, srv357905825=69, srv1910281071=48, srv1996707325=52, srv1376455142=24, srv33278753=68, srv397491700=71, srv746638883=89, srv1864584672=46, srv1264291604=18, srv804218838=91, srv1805032473=42, srv360954489=70, srv1115657303=10, srv520327483=78, srv1914394489=49, srv1184572145=15, srv139380133=28, srv214964754=61, srv1921468612=50, srv1303107811=20, srv1805273182=43, srv522564997=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:06,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:06,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:06,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:06,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:06,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:06,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:06,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:06,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:06,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:06,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:06,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-03 18:58:06,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-03 18:58:06,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-03 18:58:06,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-03 18:58:06,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-03 18:58:06,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-03 18:58:06,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-03 18:58:06,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-03 18:58:06,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-03 18:58:06,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-03 18:58:06,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-03 18:58:06,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-03 18:58:06,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041064219321598344, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06048067838502192, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041064219321598344, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24183333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:06,941 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-03 18:58:06,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1809154283052558, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041064219321598344, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06048067838502192, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041064219321598344, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24183333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-03 18:58:07,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 287 ms to try 5000 different iterations.  Found a solution that moves 2556 regions; Going from a computed imbalance of 0.1809154283052558 to a new imbalance of 0.016485657933131302. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022507706069761046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03762894031554015, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.284, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022507706069761046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,125 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1466014896:79 , srv1359039582:80 , srv224154618:80 , srv515815107:80 , srv1150205551:81 , srv139380133:81 , srv2015374266:81 , srv412329010:81 , srv1001365100:82 , srv1586875409:82 , srv1914394489:82 , srv2057910081:82 , srv436464841:82 , srv79427703:82 , srv1057022946:83 , srv1184572145:83 , srv1240443463:83 , srv1661218241:83 , srv1921468612:83 , srv2068832214:83 , srv1074612860:84 , srv1115657303:84 , srv1130907080:84 , srv1387317581:84 , srv140165001:84 , srv1775464074:84 , srv214964754:84 , srv245261828:84 , srv397491700:84 , srv537162215:84 , srv804218838:84 , srv1015573215:85 , srv1133604459:85 , srv1224842154:85 , srv1264291604:85 , srv1303107811:85 , srv1436066061:85 , srv1805032473:85 , srv1816293264:85 , srv1864584672:85 , srv1910281071:85 , srv460081448:85 , srv554393544:85 , srv557534720:85 , srv616852558:85 , srv871691532:85 , srv1066290082:86 , srv1077657349:86 , srv1270581221:86 , srv1671722915:86 , srv253608899:86 , srv357905825:86 , srv610910133:86 , srv827081982:86 , srv895030035:86 , srv910590724:86 , srv92628264:86 , srv1042173424:87 , srv1376455142:87 , srv1391855685:87 , srv1410860130:87 , srv1617709878:87 , srv1632889483:87 , srv1796329898:87 , srv1817933515:87 , srv2002409210:87 , srv2038435652:87 , srv2095588185:87 , srv255718157:87 , srv520327483:87 , srv532640527:87 , srv704914554:87 , srv809081263:87 , srv1338693249:88 , srv1374673826:88 , srv1584706949:88 , srv1710449845:88 , srv1805273182:88 , srv1949205619:88 , srv1996707325:88 , srv2134303480:88 , srv304911926:88 , srv522564997:88 , srv598959397:88 , srv723146057:88 , srv965134004:88 , srv1030241346:89 , srv1383972878:89 , srv1894634998:89 , srv360954489:89 , srv398720163:89 , srv399272342:89 , srv1099656931:90 , srv1132668976:90 , srv294759853:90 , srv33278753:90 , srv746638883:90 , srv2045378372:91 , srv105860932:92 , srv830660428:519 }
2023-11-03 18:58:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1817933515=45, srv1584706949=33, srv1661218241=37, srv871691532=95, srv554393544=82, srv616852558=86, srv224154618=62, srv809081263=92, srv2057910081=57, srv537162215=81, srv704914554=87, srv1224842154=16, srv1466014896=32, srv965134004=99, srv827081982=93, srv253608899=64, srv895030035=96, srv1066290082=6, srv140165001=29, srv2134303480=60, srv255718157=65, srv1132668976=12, srv1270581221=19, srv1015573215=1, srv1816293264=44, srv1383972878=25, srv1150205551=14, srv1359039582=22, srv2002409210=53, srv92628264=98, srv1387317581=26, srv1240443463=17, srv1949205619=51, srv1374673826=23, srv436464841=75, srv1586875409=34, srv460081448=76, srv1775464074=40, srv1042173424=3, srv245261828=63, srv1410860130=30, srv294759853=66, srv2068832214=58, srv1074612860=7, srv610910133=85, srv399272342=73, srv830660428=94, srv2038435652=55, srv1710449845=39, srv910590724=97, srv1894634998=47, srv398720163=72, srv412329010=74, srv79427703=90, srv1130907080=11, srv304911926=67, srv1077657349=8, srv1617709878=35, srv532640527=80, srv1391855685=27, srv2095588185=59, srv515815107=77, srv1057022946=4, srv105860932=5, srv598959397=84, srv1632889483=36, srv1796329898=41, srv2045378372=56, srv1133604459=13, srv1671722915=38, srv1001365100=0, srv723146057=88, srv2015374266=54, srv1099656931=9, srv1436066061=31, srv557534720=83, srv1338693249=21, srv1030241346=2, srv357905825=69, srv1910281071=48, srv1996707325=52, srv1376455142=24, srv33278753=68, srv397491700=71, srv746638883=89, srv1864584672=46, srv1264291604=18, srv804218838=91, srv1805032473=42, srv360954489=70, srv1115657303=10, srv520327483=78, srv1914394489=49, srv1184572145=15, srv139380133=28, srv214964754=61, srv1921468612=50, srv1303107811=20, srv1805273182=43, srv522564997=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:07,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:07,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:07,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:07,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-03 18:58:07,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-03 18:58:07,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-03 18:58:07,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-03 18:58:07,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-03 18:58:07,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-03 18:58:07,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-03 18:58:07,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-03 18:58:07,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022507706069761046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03762894031554015, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022507706069761046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,248 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-03 18:58:07,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016467760438600484, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022507706069761046); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03762894031554015, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022507706069761046); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-03 18:58:07,400 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 225 ms to try 5000 different iterations.  Found a solution that moves 977 regions; Going from a computed imbalance of 0.016467760438600484 to a new imbalance of 9.093804215876053E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054249519356559806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009698021828443195); MoveCostFunction : (multiplier=7.0, imbalance=0.10855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054249519356559806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,401 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1264291604:81 , srv1030241346:82 , srv2045378372:82 , srv1338693249:83 , srv1949205619:83 , srv360954489:83 , srv436464841:83 , srv515815107:83 , srv105860932:84 , srv1099656931:84 , srv1383972878:84 , srv1584706949:84 , srv1671722915:84 , srv1805273182:84 , srv1914394489:84 , srv2038435652:84 , srv2134303480:84 , srv245261828:84 , srv294759853:84 , srv33278753:84 , srv399272342:84 , srv520327483:84 , srv610910133:84 , srv723146057:84 , srv809081263:84 , srv827081982:84 , srv92628264:84 , srv1115657303:85 , srv1374673826:85 , srv1391855685:85 , srv1410860130:85 , srv1466014896:85 , srv1586875409:85 , srv1617709878:85 , srv1817933515:85 , srv214964754:85 , srv616852558:85 , srv746638883:85 , srv895030035:85 , srv965134004:85 , srv1015573215:86 , srv1042173424:86 , srv1057022946:86 , srv1066290082:86 , srv1132668976:86 , srv1150205551:86 , srv1224842154:86 , srv1240443463:86 , srv1303107811:86 , srv1359039582:86 , srv1376455142:86 , srv1436066061:86 , srv1632889483:86 , srv1710449845:86 , srv1775464074:86 , srv1796329898:86 , srv1816293264:86 , srv1894634998:86 , srv1910281071:86 , srv1921468612:86 , srv2002409210:86 , srv2015374266:86 , srv2095588185:86 , srv224154618:86 , srv255718157:86 , srv357905825:86 , srv397491700:86 , srv398720163:86 , srv532640527:86 , srv537162215:86 , srv554393544:86 , srv557534720:86 , srv704914554:86 , srv871691532:86 , srv910590724:86 , srv1074612860:87 , srv1184572145:87 , srv1270581221:87 , srv1387317581:87 , srv139380133:87 , srv140165001:87 , srv1805032473:87 , srv1864584672:87 , srv1996707325:87 , srv2057910081:87 , srv304911926:87 , srv412329010:87 , srv460081448:87 , srv522564997:87 , srv598959397:87 , srv79427703:87 , srv1001365100:88 , srv1077657349:88 , srv1130907080:88 , srv1133604459:88 , srv1661218241:88 , srv253608899:88 , srv804218838:88 , srv2068832214:89 , srv830660428:532 }
2023-11-03 18:58:07,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:07,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1817933515=45, srv1584706949=33, srv1661218241=37, srv871691532=95, srv554393544=82, srv616852558=86, srv224154618=62, srv809081263=92, srv2057910081=57, srv537162215=81, srv704914554=87, srv1224842154=16, srv1466014896=32, srv965134004=99, srv827081982=93, srv253608899=64, srv895030035=96, srv1066290082=6, srv140165001=29, srv2134303480=60, srv255718157=65, srv1132668976=12, srv1270581221=19, srv1015573215=1, srv1816293264=44, srv1383972878=25, srv1150205551=14, srv1359039582=22, srv2002409210=53, srv92628264=98, srv1387317581=26, srv1240443463=17, srv1949205619=51, srv1374673826=23, srv436464841=75, srv1586875409=34, srv460081448=76, srv1775464074=40, srv1042173424=3, srv245261828=63, srv1410860130=30, srv294759853=66, srv2068832214=58, srv1074612860=7, srv610910133=85, srv399272342=73, srv830660428=94, srv2038435652=55, srv1710449845=39, srv910590724=97, srv1894634998=47, srv398720163=72, srv412329010=74, srv79427703=90, srv1130907080=11, srv304911926=67, srv1077657349=8, srv1617709878=35, srv532640527=80, srv1391855685=27, srv2095588185=59, srv515815107=77, srv1057022946=4, srv105860932=5, srv598959397=84, srv1632889483=36, srv1796329898=41, srv2045378372=56, srv1133604459=13, srv1671722915=38, srv1001365100=0, srv723146057=88, srv2015374266=54, srv1099656931=9, srv1436066061=31, srv557534720=83, srv1338693249=21, srv1030241346=2, srv357905825=69, srv1910281071=48, srv1996707325=52, srv1376455142=24, srv33278753=68, srv397491700=71, srv746638883=89, srv1864584672=46, srv1264291604=18, srv804218838=91, srv1805032473=42, srv360954489=70, srv1115657303=10, srv520327483=78, srv1914394489=49, srv1184572145=15, srv139380133=28, srv214964754=61, srv1921468612=50, srv1303107811=20, srv1805273182=43, srv522564997=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:07,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:07,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-03 18:58:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-03 18:58:07,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-03 18:58:07,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-03 18:58:07,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-03 18:58:07,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-03 18:58:07,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-03 18:58:07,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054249519356559806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009698021828443195); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054249519356559806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,506 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-03 18:58:07,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.025393213698385E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054249519356559806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009698021828443195); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054249519356559806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-03 18:58:07,720 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 285 ms to try 5000 different iterations.  Found a solution that moves 277 regions; Going from a computed imbalance of 9.025393213698385E-4 to a new imbalance of 2.9098714229923297E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.03077777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,721 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2057910081:83 , srv255718157:83 , srv910590724:83 , srv1001365100:84 , srv1042173424:84 , srv1057022946:84 , srv105860932:84 , srv1066290082:84 , srv1074612860:84 , srv1077657349:84 , srv1115657303:84 , srv1130907080:84 , srv1132668976:84 , srv1150205551:84 , srv1184572145:84 , srv1224842154:84 , srv1240443463:84 , srv1374673826:84 , srv1376455142:84 , srv1383972878:84 , srv1387317581:84 , srv1391855685:84 , srv139380133:84 , srv1436066061:84 , srv1466014896:84 , srv1661218241:84 , srv1805032473:84 , srv1817933515:84 , srv1914394489:84 , srv1949205619:84 , srv1996707325:84 , srv2038435652:84 , srv2045378372:84 , srv2068832214:84 , srv253608899:84 , srv294759853:84 , srv357905825:84 , srv360954489:84 , srv397491700:84 , srv398720163:84 , srv399272342:84 , srv412329010:84 , srv515815107:84 , srv522564997:84 , srv532640527:84 , srv598959397:84 , srv610910133:84 , srv804218838:84 , srv827081982:84 , srv871691532:84 , srv92628264:84 , srv965134004:84 , srv1015573215:85 , srv1030241346:85 , srv1099656931:85 , srv1133604459:85 , srv1264291604:85 , srv1270581221:85 , srv1303107811:85 , srv1338693249:85 , srv1359039582:85 , srv140165001:85 , srv1410860130:85 , srv1584706949:85 , srv1586875409:85 , srv1632889483:85 , srv1671722915:85 , srv1775464074:85 , srv1796329898:85 , srv1805273182:85 , srv1816293264:85 , srv1864584672:85 , srv1894634998:85 , srv1910281071:85 , srv1921468612:85 , srv2002409210:85 , srv2015374266:85 , srv2095588185:85 , srv2134303480:85 , srv214964754:85 , srv224154618:85 , srv245261828:85 , srv304911926:85 , srv33278753:85 , srv436464841:85 , srv460081448:85 , srv520327483:85 , srv554393544:85 , srv616852558:85 , srv704914554:85 , srv723146057:85 , srv746638883:85 , srv79427703:85 , srv809081263:85 , srv895030035:85 , srv1617709878:86 , srv1710449845:86 , srv537162215:86 , srv557534720:86 , srv830660428:636 }
2023-11-03 18:58:07,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:07,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1817933515=45, srv1584706949=33, srv1661218241=37, srv871691532=95, srv554393544=82, srv616852558=86, srv224154618=62, srv809081263=92, srv2057910081=57, srv537162215=81, srv704914554=87, srv1224842154=16, srv1466014896=32, srv965134004=99, srv827081982=93, srv253608899=64, srv895030035=96, srv1066290082=6, srv140165001=29, srv2134303480=60, srv255718157=65, srv1132668976=12, srv1270581221=19, srv1015573215=1, srv1816293264=44, srv1383972878=25, srv1150205551=14, srv1359039582=22, srv2002409210=53, srv92628264=98, srv1387317581=26, srv1240443463=17, srv1949205619=51, srv1374673826=23, srv436464841=75, srv1586875409=34, srv460081448=76, srv1775464074=40, srv1042173424=3, srv245261828=63, srv1410860130=30, srv294759853=66, srv2068832214=58, srv1074612860=7, srv610910133=85, srv399272342=73, srv830660428=94, srv2038435652=55, srv1710449845=39, srv910590724=97, srv1894634998=47, srv398720163=72, srv412329010=74, srv79427703=90, srv1130907080=11, srv304911926=67, srv1077657349=8, srv1617709878=35, srv532640527=80, srv1391855685=27, srv2095588185=59, srv515815107=77, srv1057022946=4, srv105860932=5, srv598959397=84, srv1632889483=36, srv1796329898=41, srv2045378372=56, srv1133604459=13, srv1671722915=38, srv1001365100=0, srv723146057=88, srv2015374266=54, srv1099656931=9, srv1436066061=31, srv557534720=83, srv1338693249=21, srv1030241346=2, srv357905825=69, srv1910281071=48, srv1996707325=52, srv1376455142=24, srv33278753=68, srv397491700=71, srv746638883=89, srv1864584672=46, srv1264291604=18, srv804218838=91, srv1805032473=42, srv360954489=70, srv1115657303=10, srv520327483=78, srv1914394489=49, srv1184572145=15, srv139380133=28, srv214964754=61, srv1921468612=50, srv1303107811=20, srv1805273182=43, srv522564997=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:07,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:07,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-03 18:58:07,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-03 18:58:07,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-03 18:58:07,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-03 18:58:07,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-03 18:58:07,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-03 18:58:07,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-03 18:58:07,816 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,816 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-03 18:58:07,816 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7159118774118367E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-03 18:58:07,956 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 209 ms to try 5000 different iterations.  Found a solution that moves 34 regions; Going from a computed imbalance of 2.7159118774118367E-5 to a new imbalance of 7.6258305887507095E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.003777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:07,961 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1015573215:83 , srv1617709878:83 , srv1710449845:83 , srv1910281071:83 , srv214964754:83 , srv304911926:83 , srv537162215:83 , srv557534720:83 , srv1001365100:84 , srv1030241346:84 , srv1042173424:84 , srv1057022946:84 , srv105860932:84 , srv1074612860:84 , srv1077657349:84 , srv1099656931:84 , srv1130907080:84 , srv1132668976:84 , srv1133604459:84 , srv1224842154:84 , srv1240443463:84 , srv1264291604:84 , srv1270581221:84 , srv1303107811:84 , srv1338693249:84 , srv1376455142:84 , srv1383972878:84 , srv1387317581:84 , srv1391855685:84 , srv139380133:84 , srv140165001:84 , srv1410860130:84 , srv1436066061:84 , srv1466014896:84 , srv1584706949:84 , srv1586875409:84 , srv1632889483:84 , srv1661218241:84 , srv1671722915:84 , srv1775464074:84 , srv1796329898:84 , srv1805032473:84 , srv1805273182:84 , srv1816293264:84 , srv1817933515:84 , srv1864584672:84 , srv1894634998:84 , srv1914394489:84 , srv1921468612:84 , srv1949205619:84 , srv1996707325:84 , srv2002409210:84 , srv2015374266:84 , srv2038435652:84 , srv2045378372:84 , srv2057910081:84 , srv2068832214:84 , srv2095588185:84 , srv2134303480:84 , srv224154618:84 , srv245261828:84 , srv253608899:84 , srv255718157:84 , srv33278753:84 , srv357905825:84 , srv360954489:84 , srv397491700:84 , srv398720163:84 , srv399272342:84 , srv412329010:84 , srv436464841:84 , srv460081448:84 , srv515815107:84 , srv520327483:84 , srv522564997:84 , srv532640527:84 , srv554393544:84 , srv598959397:84 , srv610910133:84 , srv616852558:84 , srv704914554:84 , srv723146057:84 , srv746638883:84 , srv79427703:84 , srv804218838:84 , srv809081263:84 , srv827081982:84 , srv871691532:84 , srv895030035:84 , srv910590724:84 , srv965134004:84 , srv1066290082:85 , srv1115657303:85 , srv1150205551:85 , srv1184572145:85 , srv1359039582:85 , srv1374673826:85 , srv294759853:85 , srv92628264:85 , srv830660428:684 }
2023-11-03 18:58:07,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:07,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1817933515=45, srv1584706949=33, srv1661218241=37, srv871691532=95, srv554393544=82, srv616852558=86, srv224154618=62, srv809081263=92, srv2057910081=57, srv537162215=81, srv704914554=87, srv1224842154=16, srv1466014896=32, srv965134004=99, srv827081982=93, srv253608899=64, srv895030035=96, srv1066290082=6, srv140165001=29, srv2134303480=60, srv255718157=65, srv1132668976=12, srv1270581221=19, srv1015573215=1, srv1816293264=44, srv1383972878=25, srv1150205551=14, srv1359039582=22, srv2002409210=53, srv92628264=98, srv1387317581=26, srv1240443463=17, srv1949205619=51, srv1374673826=23, srv436464841=75, srv1586875409=34, srv460081448=76, srv1775464074=40, srv1042173424=3, srv245261828=63, srv1410860130=30, srv294759853=66, srv2068832214=58, srv1074612860=7, srv610910133=85, srv399272342=73, srv830660428=94, srv2038435652=55, srv1710449845=39, srv910590724=97, srv1894634998=47, srv398720163=72, srv412329010=74, srv79427703=90, srv1130907080=11, srv304911926=67, srv1077657349=8, srv1617709878=35, srv532640527=80, srv1391855685=27, srv2095588185=59, srv515815107=77, srv1057022946=4, srv105860932=5, srv598959397=84, srv1632889483=36, srv1796329898=41, srv2045378372=56, srv1133604459=13, srv1671722915=38, srv1001365100=0, srv723146057=88, srv2015374266=54, srv1099656931=9, srv1436066061=31, srv557534720=83, srv1338693249=21, srv1030241346=2, srv357905825=69, srv1910281071=48, srv1996707325=52, srv1376455142=24, srv33278753=68, srv397491700=71, srv746638883=89, srv1864584672=46, srv1264291604=18, srv804218838=91, srv1805032473=42, srv360954489=70, srv1115657303=10, srv520327483=78, srv1914394489=49, srv1184572145=15, srv139380133=28, srv214964754=61, srv1921468612=50, srv1303107811=20, srv1805273182=43, srv522564997=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:07,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:07,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-03 18:58:07,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-03 18:58:07,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-03 18:58:07,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-03 18:58:07,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-03 18:58:08,056 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:08,056 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1015573215:83 , srv1617709878:83 , srv1710449845:83 , srv1910281071:83 , srv214964754:83 , srv304911926:83 , srv537162215:83 , srv557534720:83 , srv1001365100:84 , srv1030241346:84 , srv1042173424:84 , srv1057022946:84 , srv105860932:84 , srv1074612860:84 , srv1077657349:84 , srv1099656931:84 , srv1130907080:84 , srv1132668976:84 , srv1133604459:84 , srv1224842154:84 , srv1240443463:84 , srv1264291604:84 , srv1270581221:84 , srv1303107811:84 , srv1338693249:84 , srv1376455142:84 , srv1383972878:84 , srv1387317581:84 , srv1391855685:84 , srv139380133:84 , srv140165001:84 , srv1410860130:84 , srv1436066061:84 , srv1466014896:84 , srv1584706949:84 , srv1586875409:84 , srv1632889483:84 , srv1661218241:84 , srv1671722915:84 , srv1775464074:84 , srv1796329898:84 , srv1805032473:84 , srv1805273182:84 , srv1816293264:84 , srv1817933515:84 , srv1864584672:84 , srv1894634998:84 , srv1914394489:84 , srv1921468612:84 , srv1949205619:84 , srv1996707325:84 , srv2002409210:84 , srv2015374266:84 , srv2038435652:84 , srv2045378372:84 , srv2057910081:84 , srv2068832214:84 , srv2095588185:84 , srv2134303480:84 , srv224154618:84 , srv245261828:84 , srv253608899:84 , srv255718157:84 , srv33278753:84 , srv357905825:84 , srv360954489:84 , srv397491700:84 , srv398720163:84 , srv399272342:84 , srv412329010:84 , srv436464841:84 , srv460081448:84 , srv515815107:84 , srv520327483:84 , srv522564997:84 , srv532640527:84 , srv554393544:84 , srv598959397:84 , srv610910133:84 , srv616852558:84 , srv704914554:84 , srv723146057:84 , srv746638883:84 , srv79427703:84 , srv804218838:84 , srv809081263:84 , srv827081982:84 , srv871691532:84 , srv895030035:84 , srv910590724:84 , srv965134004:84 , srv1066290082:85 , srv1115657303:85 , srv1150205551:85 , srv1184572145:85 , srv1359039582:85 , srv1374673826:85 , srv294759853:85 , srv92628264:85 , srv830660428:684 }
2023-11-03 18:58:08,075 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 297), ProcessCount=167 (was 167), AvailableMemoryMB=9571 (was 10058)
2023-11-03 18:58:08,081 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=167, AvailableMemoryMB=9570
2023-11-03 18:58:08,082 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-03 18:58:08,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-03 18:58:08,094 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1196795015:84 , srv1256727957:84 , srv1296664835:84 , srv1416623892:84 , srv1423319654:84 , srv1499766481:84 , srv1558492761:84 , srv1702471521:84 , srv1726814869:84 , srv1769194753:84 , srv1781428976:84 , srv1847394090:84 , srv1908458899:84 , srv1912027400:84 , srv1935515840:84 , srv1937587883:84 , srv1994129944:84 , srv2000017865:84 , srv2068594862:84 , srv265919017:84 , srv407706794:84 , srv457365993:84 , srv48230625:84 , srv657959046:84 , srv774894570:84 , srv81074343:84 , srv834077739:84 , srv872721315:84 , srv909537058:84 , srv965902579:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-03 18:58:08,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 18:58:08,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1847394090=11, srv1196795015=0, srv1416623892=3, srv48230625=22, srv1908458899=12, srv2068594862=18, srv1558492761=6, srv1935515840=14, srv909537058=28, srv872721315=27, srv1937587883=15, srv1912027400=13, srv81074343=25, srv1296664835=2, srv1769194753=9, srv1256727957=1, srv1702471521=7, srv1726814869=8, srv834077739=26, srv1423319654=4, srv2000017865=17, srv457365993=21, srv407706794=20, srv1994129944=16, srv265919017=19, srv965902579=29, srv1499766481=5, srv1781428976=10, srv774894570=24, srv657959046=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 18:58:08,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 18:58:08,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-03 18:58:08,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1441242413567476, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 18:58:08,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912647174042705, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1441242413567476, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-03 19:00:08,112 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9603086 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912647174042705 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 19:00:08,118 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1196795015:90 , srv1256727957:90 , srv1296664835:90 , srv1416623892:90 , srv1423319654:90 , srv1499766481:90 , srv1558492761:90 , srv1702471521:90 , srv1726814869:90 , srv1769194753:90 , srv1781428976:90 , srv1847394090:90 , srv1908458899:90 , srv1912027400:90 , srv1935515840:90 , srv1937587883:90 , srv1994129944:90 , srv2000017865:90 , srv2068594862:90 , srv265919017:90 , srv407706794:90 , srv457365993:90 , srv48230625:90 , srv657959046:90 , srv774894570:90 , srv81074343:90 , srv834077739:90 , srv872721315:90 , srv909537058:90 , srv965902579:90 }
2023-11-03 19:00:08,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-03 19:00:08,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1847394090=11, srv1196795015=0, srv1416623892=3, srv48230625=22, srv1908458899=12, srv2068594862=18, srv1558492761=6, srv1935515840=14, srv909537058=28, srv872721315=27, srv1937587883=15, srv1912027400=13, srv81074343=25, srv1296664835=2, srv1769194753=9, srv1256727957=1, srv1702471521=7, srv1726814869=8, srv834077739=26, srv1423319654=4, srv2000017865=17, srv457365993=21, srv407706794=20, srv1994129944=16, srv265919017=19, srv965902579=29, srv1499766481=5, srv1781428976=10, srv774894570=24, srv657959046=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-03 19:00:08,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-03 19:00:08,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-03 19:00:08,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-03 19:00:08,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-03 19:00:08,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-03 19:00:08,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-03 19:00:08,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-03 19:00:08,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-03 19:00:08,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-03 19:00:08,137 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-03 19:00:08,138 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1196795015:90 , srv1256727957:90 , srv1296664835:90 , srv1416623892:90 , srv1423319654:90 , srv1499766481:90 , srv1558492761:90 , srv1702471521:90 , srv1726814869:90 , srv1769194753:90 , srv1781428976:90 , srv1847394090:90 , srv1908458899:90 , srv1912027400:90 , srv1935515840:90 , srv1937587883:90 , srv1994129944:90 , srv2000017865:90 , srv2068594862:90 , srv265919017:90 , srv407706794:90 , srv457365993:90 , srv48230625:90 , srv657959046:90 , srv774894570:90 , srv81074343:90 , srv834077739:90 , srv872721315:90 , srv909537058:90 , srv965902579:90 }
2023-11-03 19:00:08,148 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 297), ProcessCount=165 (was 167), AvailableMemoryMB=9395 (was 9570)