2023-09-05 09:53:08,414 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-05 09:53:08,732 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-05 09:53:08,855 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-05 09:53:08,918 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-05 09:53:08,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-05 09:53:08,944 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=171, AvailableMemoryMB=9978
2023-09-05 09:53:08,946 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-05 09:53:08,946 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-05 09:53:09,087 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033480513:84 , srv1054740789:84 , srv1070759591:84 , srv1083710194:84 , srv108622867:84 , srv1088932981:84 , srv111119072:84 , srv1112696411:84 , srv1150249092:84 , srv1153245886:84 , srv1174972271:84 , srv1206928531:84 , srv1219803395:84 , srv1340415272:84 , srv1347926044:84 , srv1386498568:84 , srv1403721934:84 , srv1406992855:84 , srv1428312745:84 , srv1439319976:84 , srv1478144336:84 , srv1497831410:84 , srv1519975659:84 , srv1539230719:84 , srv1556062603:84 , srv1589283235:84 , srv1632347302:84 , srv1667121310:84 , srv1681318998:84 , srv1697209081:84 , srv170920518:84 , srv1723516873:84 , srv176359687:84 , srv17990835:84 , srv180317265:84 , srv1823838388:84 , srv1857009967:84 , srv1865623814:84 , srv1877568295:84 , srv1885509977:84 , srv1923421858:84 , srv1936934179:84 , srv1941103670:84 , srv1952293016:84 , srv1982217765:84 , srv1986681297:84 , srv1994907598:84 , srv2052870226:84 , srv2070218902:84 , srv2071904323:84 , srv2101110679:84 , srv2101795225:84 , srv2107770388:84 , srv212141470:84 , srv269657841:84 , srv298409512:84 , srv352909448:84 , srv358737756:84 , srv361911691:84 , srv378960601:84 , srv382157114:84 , srv389272922:84 , srv392016980:84 , srv398541187:84 , srv419112600:84 , srv427262217:84 , srv42757659:84 , srv490397857:84 , srv514136550:84 , srv515986801:84 , srv519709978:84 , srv528404877:84 , srv551079998:84 , srv571518487:84 , srv575521698:84 , srv580432900:84 , srv59620354:84 , srv624725101:84 , srv637655597:84 , srv639942218:84 , srv689637376:84 , srv706247617:84 , srv723765582:84 , srv739056787:84 , srv786511717:84 , srv798503070:84 , srv800054467:84 , srv805366139:84 , srv845138444:84 , srv850846227:84 , srv853414485:84 , srv86644566:84 , srv869882460:84 , srv8818182:84 , srv896895614:84 , srv916291411:84 , srv929572479:84 , srv953170624:84 , srv976351713:84 , srv513729964:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-05 09:53:09,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:09,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv519709978=71, srv392016980=62, srv1697209081=29, srv358737756=57, srv2101795225=51, srv361911691=58, srv42757659=66, srv2107770388=52, srv1403721934=16, srv800054467=87, srv916291411=96, srv1206928531=11, srv212141470=53, srv580432900=76, srv2070218902=48, srv1823838388=35, srv17990835=33, srv1054740789=1, srv1070759591=2, srv1877568295=38, srv1982217765=44, srv269657841=54, srv1885509977=39, srv739056787=84, srv786511717=85, srv398541187=63, srv639942218=80, srv1857009967=36, srv2052870226=47, srv1556062603=24, srv108622867=4, srv1986681297=45, srv378960601=59, srv571518487=74, srv976351713=99, srv575521698=75, srv176359687=32, srv298409512=55, srv2071904323=49, srv706247617=82, srv490397857=67, srv723765582=83, srv1865623814=37, srv1923421858=40, srv427262217=65, srv896895614=95, srv8818182=94, srv1589283235=25, srv419112600=64, srv1219803395=12, srv1539230719=23, srv1428312745=18, srv1386498568=15, srv170920518=30, srv1340415272=13, srv1347926044=14, srv1632347302=26, srv180317265=34, srv1497831410=21, srv1952293016=43, srv111119072=6, srv1723516873=31, srv1112696411=7, srv513729964=68, srv514136550=69, srv624725101=78, srv2101110679=50, srv1174972271=10, srv528404877=72, srv850846227=90, srv853414485=91, srv515986801=70, srv1033480513=0, srv382157114=60, srv1083710194=3, srv1681318998=28, srv1153245886=9, srv352909448=56, srv869882460=93, srv1439319976=19, srv1994907598=46, srv689637376=81, srv805366139=88, srv953170624=98, srv86644566=92, srv1941103670=42, srv59620354=77, srv551079998=73, srv845138444=89, srv929572479=97, srv1478144336=20, srv637655597=79, srv798503070=86, srv1667121310=27, srv1150249092=8, srv1406992855=17, srv1519975659=22, srv1088932981=5, srv1936934179=41, srv389272922=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:09,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:09,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:09,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:09,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:09,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:09,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:09,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:09,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:09,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:09,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:09,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:09,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:09,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:09,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:09,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:09,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:09,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:09,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:09,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:09,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:09,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-05 09:53:09,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-05 09:53:09,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-05 09:53:09,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-05 09:53:09,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-05 09:53:09,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-05 09:53:09,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-05 09:53:09,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-05 09:53:09,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-05 09:53:09,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-05 09:53:09,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-05 09:53:09,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-05 09:53:09,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-05 09:53:09,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-05 09:53:09,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-05 09:53:09,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-05 09:53:09,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-05 09:53:09,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-05 09:53:09,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-05 09:53:09,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-05 09:53:09,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-05 09:53:09,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-05 09:53:09,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-05 09:53:09,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-05 09:53:09,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-05 09:53:09,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-05 09:53:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-05 09:53:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-05 09:53:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-05 09:53:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-05 09:53:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-05 09:53:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-05 09:53:09,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-05 09:53:09,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-05 09:53:09,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-05 09:53:09,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-05 09:53:09,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-05 09:53:09,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-05 09:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-05 09:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-05 09:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-05 09:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-05 09:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-05 09:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-05 09:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-05 09:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-05 09:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-05 09:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-05 09:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-05 09:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-05 09:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-05 09:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-05 09:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-05 09:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-05 09:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-05 09:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-05 09:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-05 09:53:09,446 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:09,447 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-05 09:53:09,447 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-05 09:53:09,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 596 ms to try 5000 different iterations.  Found a solution that moves 4730 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17541899421201904. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04079946792686274, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0556846983840172, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5255555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04079946792686274, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17025, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:09,851 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv111119072:83 , srv1406992855:83 , srv382157114:83 , srv519709978:83 , srv1083710194:84 , srv1150249092:84 , srv1439319976:84 , srv1667121310:84 , srv1697209081:84 , srv1723516873:84 , srv1823838388:84 , srv1936934179:84 , srv514136550:84 , srv515986801:84 , srv528404877:84 , srv706247617:84 , srv916291411:84 , srv1033480513:85 , srv1153245886:85 , srv1174972271:85 , srv1428312745:85 , srv1478144336:85 , srv1539230719:85 , srv1632347302:85 , srv17990835:85 , srv1877568295:85 , srv1885509977:85 , srv1923421858:85 , srv2052870226:85 , srv2101110679:85 , srv212141470:85 , srv378960601:85 , srv392016980:85 , srv398541187:85 , srv490397857:85 , srv551079998:85 , srv571518487:85 , srv59620354:85 , srv624725101:85 , srv798503070:85 , srv929572479:85 , srv1054740789:86 , srv1340415272:86 , srv1386498568:86 , srv1403721934:86 , srv180317265:86 , srv1865623814:86 , srv1982217765:86 , srv2070218902:86 , srv269657841:86 , srv358737756:86 , srv419112600:86 , srv723765582:86 , srv739056787:86 , srv786511717:86 , srv805366139:86 , srv845138444:86 , srv1112696411:87 , srv1206928531:87 , srv1219803395:87 , srv1347926044:87 , srv1556062603:87 , srv1952293016:87 , srv2071904323:87 , srv2101795225:87 , srv2107770388:87 , srv361911691:87 , srv42757659:87 , srv800054467:87 , srv850846227:87 , srv86644566:87 , srv869882460:87 , srv108622867:88 , srv1088932981:88 , srv1497831410:88 , srv170920518:88 , srv298409512:88 , srv427262217:88 , srv639942218:88 , srv8818182:88 , srv976351713:88 , srv1070759591:89 , srv1519975659:89 , srv1589283235:89 , srv176359687:89 , srv1941103670:89 , srv1986681297:89 , srv1994907598:89 , srv352909448:89 , srv389272922:89 , srv575521698:89 , srv637655597:89 , srv689637376:89 , srv853414485:89 , srv896895614:89 , srv1681318998:90 , srv953170624:90 , srv580432900:91 , srv1857009967:93 , srv513729964:453 }
2023-09-05 09:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv519709978=71, srv392016980=62, srv1697209081=29, srv358737756=57, srv2101795225=51, srv361911691=58, srv42757659=66, srv2107770388=52, srv1403721934=16, srv800054467=87, srv916291411=96, srv1206928531=11, srv212141470=53, srv580432900=76, srv2070218902=48, srv1823838388=35, srv17990835=33, srv1054740789=1, srv1070759591=2, srv1877568295=38, srv1982217765=44, srv269657841=54, srv1885509977=39, srv739056787=84, srv786511717=85, srv398541187=63, srv639942218=80, srv1857009967=36, srv2052870226=47, srv1556062603=24, srv108622867=4, srv1986681297=45, srv378960601=59, srv571518487=74, srv976351713=99, srv575521698=75, srv176359687=32, srv298409512=55, srv2071904323=49, srv706247617=82, srv490397857=67, srv723765582=83, srv1865623814=37, srv1923421858=40, srv427262217=65, srv896895614=95, srv8818182=94, srv1589283235=25, srv419112600=64, srv1219803395=12, srv1539230719=23, srv1428312745=18, srv1386498568=15, srv170920518=30, srv1340415272=13, srv1347926044=14, srv1632347302=26, srv180317265=34, srv1497831410=21, srv1952293016=43, srv111119072=6, srv1723516873=31, srv1112696411=7, srv513729964=68, srv514136550=69, srv624725101=78, srv2101110679=50, srv1174972271=10, srv528404877=72, srv850846227=90, srv853414485=91, srv515986801=70, srv1033480513=0, srv382157114=60, srv1083710194=3, srv1681318998=28, srv1153245886=9, srv352909448=56, srv869882460=93, srv1439319976=19, srv1994907598=46, srv689637376=81, srv805366139=88, srv953170624=98, srv86644566=92, srv1941103670=42, srv59620354=77, srv551079998=73, srv845138444=89, srv929572479=97, srv1478144336=20, srv637655597=79, srv798503070=86, srv1667121310=27, srv1150249092=8, srv1406992855=17, srv1519975659=22, srv1088932981=5, srv1936934179=41, srv389272922=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:09,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:09,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:09,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-05 09:53:09,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-05 09:53:09,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-05 09:53:09,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-05 09:53:09,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-05 09:53:09,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-05 09:53:09,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-05 09:53:09,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-05 09:53:09,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-05 09:53:10,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04079946792686274, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0556846983840172, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04079946792686274, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17025, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:10,055 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-05 09:53:10,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1753858740441275, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04079946792686274, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0556846983840172, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04079946792686274, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17025, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-05 09:53:10,396 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 484 ms to try 5000 different iterations.  Found a solution that moves 2698 regions; Going from a computed imbalance of 0.1753858740441275 to a new imbalance of 0.013896652218571065. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150410975838829); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02832392396740493, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29977777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150410975838829); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:10,405 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1681318998:80 , srv1857009967:80 , srv953170624:80 , srv176359687:81 , srv689637376:81 , srv1589283235:82 , srv170920518:82 , srv352909448:82 , srv853414485:82 , srv896895614:82 , srv1070759591:83 , srv108622867:83 , srv1088932981:83 , srv1112696411:83 , srv1519975659:83 , srv1556062603:83 , srv361911691:83 , srv42757659:83 , srv976351713:83 , srv1497831410:84 , srv1952293016:84 , srv1994907598:84 , srv2101795225:84 , srv212141470:84 , srv389272922:84 , srv427262217:84 , srv575521698:84 , srv639942218:84 , srv869882460:84 , srv1478144336:85 , srv1865623814:85 , srv1986681297:85 , srv419112600:85 , srv514136550:85 , srv739056787:85 , srv786511717:85 , srv8818182:85 , srv929572479:85 , srv1083710194:86 , srv1219803395:86 , srv1340415272:86 , srv1667121310:86 , srv1877568295:86 , srv1923421858:86 , srv1941103670:86 , srv1982217765:86 , srv2071904323:86 , srv269657841:86 , srv358737756:86 , srv398541187:86 , srv490397857:86 , srv723765582:86 , srv805366139:86 , srv850846227:86 , srv86644566:86 , srv1054740789:87 , srv1153245886:87 , srv1206928531:87 , srv1347926044:87 , srv1386498568:87 , srv1403721934:87 , srv1539230719:87 , srv1697209081:87 , srv17990835:87 , srv180317265:87 , srv1885509977:87 , srv2052870226:87 , srv2070218902:87 , srv2101110679:87 , srv2107770388:87 , srv298409512:87 , srv392016980:87 , srv515986801:87 , srv580432900:87 , srv637655597:87 , srv706247617:87 , srv845138444:87 , srv1150249092:88 , srv1174972271:88 , srv1406992855:88 , srv1428312745:88 , srv1823838388:88 , srv1936934179:88 , srv378960601:88 , srv382157114:88 , srv528404877:88 , srv571518487:88 , srv59620354:88 , srv798503070:88 , srv800054467:88 , srv1033480513:89 , srv1439319976:89 , srv1632347302:89 , srv1723516873:89 , srv551079998:89 , srv624725101:89 , srv111119072:90 , srv519709978:90 , srv916291411:90 , srv513729964:512 }
2023-09-05 09:53:10,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:10,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv519709978=71, srv392016980=62, srv1697209081=29, srv358737756=57, srv2101795225=51, srv361911691=58, srv42757659=66, srv2107770388=52, srv1403721934=16, srv800054467=87, srv916291411=96, srv1206928531=11, srv212141470=53, srv580432900=76, srv2070218902=48, srv1823838388=35, srv17990835=33, srv1054740789=1, srv1070759591=2, srv1877568295=38, srv1982217765=44, srv269657841=54, srv1885509977=39, srv739056787=84, srv786511717=85, srv398541187=63, srv639942218=80, srv1857009967=36, srv2052870226=47, srv1556062603=24, srv108622867=4, srv1986681297=45, srv378960601=59, srv571518487=74, srv976351713=99, srv575521698=75, srv176359687=32, srv298409512=55, srv2071904323=49, srv706247617=82, srv490397857=67, srv723765582=83, srv1865623814=37, srv1923421858=40, srv427262217=65, srv896895614=95, srv8818182=94, srv1589283235=25, srv419112600=64, srv1219803395=12, srv1539230719=23, srv1428312745=18, srv1386498568=15, srv170920518=30, srv1340415272=13, srv1347926044=14, srv1632347302=26, srv180317265=34, srv1497831410=21, srv1952293016=43, srv111119072=6, srv1723516873=31, srv1112696411=7, srv513729964=68, srv514136550=69, srv624725101=78, srv2101110679=50, srv1174972271=10, srv528404877=72, srv850846227=90, srv853414485=91, srv515986801=70, srv1033480513=0, srv382157114=60, srv1083710194=3, srv1681318998=28, srv1153245886=9, srv352909448=56, srv869882460=93, srv1439319976=19, srv1994907598=46, srv689637376=81, srv805366139=88, srv953170624=98, srv86644566=92, srv1941103670=42, srv59620354=77, srv551079998=73, srv845138444=89, srv929572479=97, srv1478144336=20, srv637655597=79, srv798503070=86, srv1667121310=27, srv1150249092=8, srv1406992855=17, srv1519975659=22, srv1088932981=5, srv1936934179=41, srv389272922=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:10,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:10,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:10,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:10,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-05 09:53:10,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-05 09:53:10,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-05 09:53:10,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-05 09:53:10,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-05 09:53:10,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-05 09:53:10,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-05 09:53:10,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-05 09:53:10,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-05 09:53:10,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150410975838829); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02832392396740493, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150410975838829); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:10,605 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-05 09:53:10,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01387776041878853, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150410975838829); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02832392396740493, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150410975838829); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-05 09:53:10,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 450 ms to try 5000 different iterations.  Found a solution that moves 1058 regions; Going from a computed imbalance of 0.01387776041878853 to a new imbalance of 7.089671541745159E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005114964633299064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005381099233077657); MoveCostFunction : (multiplier=7.0, imbalance=0.11755555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005114964633299064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:10,926 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv580432900:79 , srv1439319976:82 , srv1941103670:82 , srv637655597:82 , srv1033480513:83 , srv1206928531:83 , srv1986681297:83 , srv2107770388:83 , srv298409512:83 , srv800054467:83 , srv916291411:83 , srv1150249092:84 , srv1347926044:84 , srv1386498568:84 , srv1428312745:84 , srv1632347302:84 , srv180317265:84 , srv1857009967:84 , srv1994907598:84 , srv378960601:84 , srv551079998:84 , srv624725101:84 , srv850846227:84 , srv86644566:84 , srv1054740789:85 , srv111119072:85 , srv1174972271:85 , srv1219803395:85 , srv1403721934:85 , srv1497831410:85 , srv1519975659:85 , srv1723516873:85 , srv1823838388:85 , srv1982217765:85 , srv2070218902:85 , srv2071904323:85 , srv269657841:85 , srv352909448:85 , srv389272922:85 , srv392016980:85 , srv427262217:85 , srv490397857:85 , srv519709978:85 , srv571518487:85 , srv575521698:85 , srv59620354:85 , srv639942218:85 , srv706247617:85 , srv723765582:85 , srv798503070:85 , srv805366139:85 , srv845138444:85 , srv8818182:85 , srv108622867:86 , srv1153245886:86 , srv1340415272:86 , srv1539230719:86 , srv1877568295:86 , srv1885509977:86 , srv1936934179:86 , srv1952293016:86 , srv2052870226:86 , srv2101110679:86 , srv2101795225:86 , srv358737756:86 , srv382157114:86 , srv515986801:86 , srv528404877:86 , srv739056787:86 , srv786511717:86 , srv1070759591:87 , srv1088932981:87 , srv1112696411:87 , srv1406992855:87 , srv1478144336:87 , srv1589283235:87 , srv1681318998:87 , srv1697209081:87 , srv170920518:87 , srv17990835:87 , srv1923421858:87 , srv361911691:87 , srv398541187:87 , srv419112600:87 , srv42757659:87 , srv896895614:87 , srv929572479:87 , srv953170624:87 , srv976351713:87 , srv1083710194:88 , srv1556062603:88 , srv1667121310:88 , srv176359687:88 , srv1865623814:88 , srv853414485:88 , srv869882460:88 , srv514136550:89 , srv689637376:89 , srv212141470:90 , srv513729964:538 }
2023-09-05 09:53:10,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:10,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv519709978=71, srv392016980=62, srv1697209081=29, srv358737756=57, srv2101795225=51, srv361911691=58, srv42757659=66, srv2107770388=52, srv1403721934=16, srv800054467=87, srv916291411=96, srv1206928531=11, srv212141470=53, srv580432900=76, srv2070218902=48, srv1823838388=35, srv17990835=33, srv1054740789=1, srv1070759591=2, srv1877568295=38, srv1982217765=44, srv269657841=54, srv1885509977=39, srv739056787=84, srv786511717=85, srv398541187=63, srv639942218=80, srv1857009967=36, srv2052870226=47, srv1556062603=24, srv108622867=4, srv1986681297=45, srv378960601=59, srv571518487=74, srv976351713=99, srv575521698=75, srv176359687=32, srv298409512=55, srv2071904323=49, srv706247617=82, srv490397857=67, srv723765582=83, srv1865623814=37, srv1923421858=40, srv427262217=65, srv896895614=95, srv8818182=94, srv1589283235=25, srv419112600=64, srv1219803395=12, srv1539230719=23, srv1428312745=18, srv1386498568=15, srv170920518=30, srv1340415272=13, srv1347926044=14, srv1632347302=26, srv180317265=34, srv1497831410=21, srv1952293016=43, srv111119072=6, srv1723516873=31, srv1112696411=7, srv513729964=68, srv514136550=69, srv624725101=78, srv2101110679=50, srv1174972271=10, srv528404877=72, srv850846227=90, srv853414485=91, srv515986801=70, srv1033480513=0, srv382157114=60, srv1083710194=3, srv1681318998=28, srv1153245886=9, srv352909448=56, srv869882460=93, srv1439319976=19, srv1994907598=46, srv689637376=81, srv805366139=88, srv953170624=98, srv86644566=92, srv1941103670=42, srv59620354=77, srv551079998=73, srv845138444=89, srv929572479=97, srv1478144336=20, srv637655597=79, srv798503070=86, srv1667121310=27, srv1150249092=8, srv1406992855=17, srv1519975659=22, srv1088932981=5, srv1936934179=41, srv389272922=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:10,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:10,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-05 09:53:10,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-05 09:53:10,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-05 09:53:10,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-05 09:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-05 09:53:10,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-05 09:53:10,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-05 09:53:10,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-05 09:53:10,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-05 09:53:10,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-05 09:53:10,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-05 09:53:10,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-05 09:53:10,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-05 09:53:10,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-05 09:53:11,087 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005114964633299064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005381099233077657); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005114964633299064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:11,087 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-05 09:53:11,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.015588798342935E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005114964633299064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005381099233077657); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005114964633299064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-05 09:53:11,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 588 ms to try 5000 different iterations.  Found a solution that moves 213 regions; Going from a computed imbalance of 7.015588798342935E-4 to a new imbalance of 2.676831744542015E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.023666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:11,553 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1070759591:83 , srv1219803395:83 , srv1865623814:83 , srv1923421858:83 , srv2070218902:83 , srv212141470:83 , srv853414485:83 , srv869882460:83 , srv1054740789:84 , srv1083710194:84 , srv108622867:84 , srv111119072:84 , srv1153245886:84 , srv1174972271:84 , srv1340415272:84 , srv1347926044:84 , srv1403721934:84 , srv1406992855:84 , srv1539230719:84 , srv1556062603:84 , srv1589283235:84 , srv1632347302:84 , srv1667121310:84 , srv1697209081:84 , srv1723516873:84 , srv176359687:84 , srv17990835:84 , srv1885509977:84 , srv1936934179:84 , srv1941103670:84 , srv2052870226:84 , srv2101110679:84 , srv298409512:84 , srv358737756:84 , srv389272922:84 , srv398541187:84 , srv419112600:84 , srv514136550:84 , srv519709978:84 , srv528404877:84 , srv551079998:84 , srv571518487:84 , srv575521698:84 , srv59620354:84 , srv624725101:84 , srv637655597:84 , srv639942218:84 , srv689637376:84 , srv800054467:84 , srv845138444:84 , srv8818182:84 , srv896895614:84 , srv953170624:84 , srv976351713:84 , srv1033480513:85 , srv1088932981:85 , srv1112696411:85 , srv1206928531:85 , srv1428312745:85 , srv1478144336:85 , srv1497831410:85 , srv1519975659:85 , srv1681318998:85 , srv170920518:85 , srv180317265:85 , srv1823838388:85 , srv1857009967:85 , srv1877568295:85 , srv1952293016:85 , srv1982217765:85 , srv1986681297:85 , srv1994907598:85 , srv2071904323:85 , srv2101795225:85 , srv2107770388:85 , srv269657841:85 , srv361911691:85 , srv378960601:85 , srv382157114:85 , srv392016980:85 , srv427262217:85 , srv42757659:85 , srv515986801:85 , srv580432900:85 , srv723765582:85 , srv786511717:85 , srv798503070:85 , srv805366139:85 , srv850846227:85 , srv86644566:85 , srv916291411:85 , srv929572479:85 , srv1150249092:86 , srv1386498568:86 , srv352909448:86 , srv490397857:86 , srv706247617:86 , srv739056787:86 , srv1439319976:87 , srv513729964:639 }
2023-09-05 09:53:11,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:11,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv519709978=71, srv392016980=62, srv1697209081=29, srv358737756=57, srv2101795225=51, srv361911691=58, srv42757659=66, srv2107770388=52, srv1403721934=16, srv800054467=87, srv916291411=96, srv1206928531=11, srv212141470=53, srv580432900=76, srv2070218902=48, srv1823838388=35, srv17990835=33, srv1054740789=1, srv1070759591=2, srv1877568295=38, srv1982217765=44, srv269657841=54, srv1885509977=39, srv739056787=84, srv786511717=85, srv398541187=63, srv639942218=80, srv1857009967=36, srv2052870226=47, srv1556062603=24, srv108622867=4, srv1986681297=45, srv378960601=59, srv571518487=74, srv976351713=99, srv575521698=75, srv176359687=32, srv298409512=55, srv2071904323=49, srv706247617=82, srv490397857=67, srv723765582=83, srv1865623814=37, srv1923421858=40, srv427262217=65, srv896895614=95, srv8818182=94, srv1589283235=25, srv419112600=64, srv1219803395=12, srv1539230719=23, srv1428312745=18, srv1386498568=15, srv170920518=30, srv1340415272=13, srv1347926044=14, srv1632347302=26, srv180317265=34, srv1497831410=21, srv1952293016=43, srv111119072=6, srv1723516873=31, srv1112696411=7, srv513729964=68, srv514136550=69, srv624725101=78, srv2101110679=50, srv1174972271=10, srv528404877=72, srv850846227=90, srv853414485=91, srv515986801=70, srv1033480513=0, srv382157114=60, srv1083710194=3, srv1681318998=28, srv1153245886=9, srv352909448=56, srv869882460=93, srv1439319976=19, srv1994907598=46, srv689637376=81, srv805366139=88, srv953170624=98, srv86644566=92, srv1941103670=42, srv59620354=77, srv551079998=73, srv845138444=89, srv929572479=97, srv1478144336=20, srv637655597=79, srv798503070=86, srv1667121310=27, srv1150249092=8, srv1406992855=17, srv1519975659=22, srv1088932981=5, srv1936934179=41, srv389272922=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:11,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-05 09:53:11,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-05 09:53:11,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-05 09:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-05 09:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-05 09:53:11,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-05 09:53:11,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-05 09:53:11,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-05 09:53:11,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-05 09:53:11,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-05 09:53:11,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-05 09:53:11,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-05 09:53:11,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:11,704 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-05 09:53:11,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5276859567851735E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-05 09:53:11,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 396 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 2.5276859567851735E-5 to a new imbalance of 6.88411204703086E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:11,993 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1088932981:83 , srv1386498568:83 , srv17990835:83 , srv2071904323:83 , srv689637376:83 , srv739056787:83 , srv798503070:83 , srv1033480513:84 , srv1054740789:84 , srv1070759591:84 , srv1083710194:84 , srv111119072:84 , srv1112696411:84 , srv1150249092:84 , srv1153245886:84 , srv1174972271:84 , srv1206928531:84 , srv1340415272:84 , srv1347926044:84 , srv1403721934:84 , srv1406992855:84 , srv1428312745:84 , srv1439319976:84 , srv1478144336:84 , srv1497831410:84 , srv1519975659:84 , srv1539230719:84 , srv1556062603:84 , srv1589283235:84 , srv1632347302:84 , srv1667121310:84 , srv1681318998:84 , srv1697209081:84 , srv170920518:84 , srv1723516873:84 , srv176359687:84 , srv180317265:84 , srv1823838388:84 , srv1857009967:84 , srv1865623814:84 , srv1877568295:84 , srv1885509977:84 , srv1936934179:84 , srv1952293016:84 , srv1982217765:84 , srv1986681297:84 , srv1994907598:84 , srv2052870226:84 , srv2101110679:84 , srv2101795225:84 , srv2107770388:84 , srv212141470:84 , srv269657841:84 , srv298409512:84 , srv352909448:84 , srv358737756:84 , srv361911691:84 , srv378960601:84 , srv382157114:84 , srv389272922:84 , srv392016980:84 , srv398541187:84 , srv419112600:84 , srv427262217:84 , srv42757659:84 , srv490397857:84 , srv514136550:84 , srv515986801:84 , srv519709978:84 , srv528404877:84 , srv551079998:84 , srv571518487:84 , srv575521698:84 , srv580432900:84 , srv59620354:84 , srv624725101:84 , srv637655597:84 , srv706247617:84 , srv723765582:84 , srv786511717:84 , srv800054467:84 , srv805366139:84 , srv845138444:84 , srv850846227:84 , srv853414485:84 , srv86644566:84 , srv869882460:84 , srv8818182:84 , srv896895614:84 , srv916291411:84 , srv929572479:84 , srv976351713:84 , srv108622867:85 , srv1219803395:85 , srv1923421858:85 , srv1941103670:85 , srv2070218902:85 , srv639942218:85 , srv953170624:85 , srv513729964:684 }
2023-09-05 09:53:11,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:11,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv519709978=71, srv392016980=62, srv1697209081=29, srv358737756=57, srv2101795225=51, srv361911691=58, srv42757659=66, srv2107770388=52, srv1403721934=16, srv800054467=87, srv916291411=96, srv1206928531=11, srv212141470=53, srv580432900=76, srv2070218902=48, srv1823838388=35, srv17990835=33, srv1054740789=1, srv1070759591=2, srv1877568295=38, srv1982217765=44, srv269657841=54, srv1885509977=39, srv739056787=84, srv786511717=85, srv398541187=63, srv639942218=80, srv1857009967=36, srv2052870226=47, srv1556062603=24, srv108622867=4, srv1986681297=45, srv378960601=59, srv571518487=74, srv976351713=99, srv575521698=75, srv176359687=32, srv298409512=55, srv2071904323=49, srv706247617=82, srv490397857=67, srv723765582=83, srv1865623814=37, srv1923421858=40, srv427262217=65, srv896895614=95, srv8818182=94, srv1589283235=25, srv419112600=64, srv1219803395=12, srv1539230719=23, srv1428312745=18, srv1386498568=15, srv170920518=30, srv1340415272=13, srv1347926044=14, srv1632347302=26, srv180317265=34, srv1497831410=21, srv1952293016=43, srv111119072=6, srv1723516873=31, srv1112696411=7, srv513729964=68, srv514136550=69, srv624725101=78, srv2101110679=50, srv1174972271=10, srv528404877=72, srv850846227=90, srv853414485=91, srv515986801=70, srv1033480513=0, srv382157114=60, srv1083710194=3, srv1681318998=28, srv1153245886=9, srv352909448=56, srv869882460=93, srv1439319976=19, srv1994907598=46, srv689637376=81, srv805366139=88, srv953170624=98, srv86644566=92, srv1941103670=42, srv59620354=77, srv551079998=73, srv845138444=89, srv929572479=97, srv1478144336=20, srv637655597=79, srv798503070=86, srv1667121310=27, srv1150249092=8, srv1406992855=17, srv1519975659=22, srv1088932981=5, srv1936934179=41, srv389272922=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:12,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:12,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:12,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-05 09:53:12,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-05 09:53:12,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-05 09:53:12,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-05 09:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-05 09:53:12,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-05 09:53:12,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-05 09:53:12,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-05 09:53:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-05 09:53:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-05 09:53:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-05 09:53:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-05 09:53:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-05 09:53:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-05 09:53:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-05 09:53:12,146 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:12,147 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1088932981:83 , srv1386498568:83 , srv17990835:83 , srv2071904323:83 , srv689637376:83 , srv739056787:83 , srv798503070:83 , srv1033480513:84 , srv1054740789:84 , srv1070759591:84 , srv1083710194:84 , srv111119072:84 , srv1112696411:84 , srv1150249092:84 , srv1153245886:84 , srv1174972271:84 , srv1206928531:84 , srv1340415272:84 , srv1347926044:84 , srv1403721934:84 , srv1406992855:84 , srv1428312745:84 , srv1439319976:84 , srv1478144336:84 , srv1497831410:84 , srv1519975659:84 , srv1539230719:84 , srv1556062603:84 , srv1589283235:84 , srv1632347302:84 , srv1667121310:84 , srv1681318998:84 , srv1697209081:84 , srv170920518:84 , srv1723516873:84 , srv176359687:84 , srv180317265:84 , srv1823838388:84 , srv1857009967:84 , srv1865623814:84 , srv1877568295:84 , srv1885509977:84 , srv1936934179:84 , srv1952293016:84 , srv1982217765:84 , srv1986681297:84 , srv1994907598:84 , srv2052870226:84 , srv2101110679:84 , srv2101795225:84 , srv2107770388:84 , srv212141470:84 , srv269657841:84 , srv298409512:84 , srv352909448:84 , srv358737756:84 , srv361911691:84 , srv378960601:84 , srv382157114:84 , srv389272922:84 , srv392016980:84 , srv398541187:84 , srv419112600:84 , srv427262217:84 , srv42757659:84 , srv490397857:84 , srv514136550:84 , srv515986801:84 , srv519709978:84 , srv528404877:84 , srv551079998:84 , srv571518487:84 , srv575521698:84 , srv580432900:84 , srv59620354:84 , srv624725101:84 , srv637655597:84 , srv706247617:84 , srv723765582:84 , srv786511717:84 , srv800054467:84 , srv805366139:84 , srv845138444:84 , srv850846227:84 , srv853414485:84 , srv86644566:84 , srv869882460:84 , srv8818182:84 , srv896895614:84 , srv916291411:84 , srv929572479:84 , srv976351713:84 , srv108622867:85 , srv1219803395:85 , srv1923421858:85 , srv1941103670:85 , srv2070218902:85 , srv639942218:85 , srv953170624:85 , srv513729964:684 }
2023-09-05 09:53:12,173 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=356 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 171), AvailableMemoryMB=9120 (was 9978)
2023-09-05 09:53:12,184 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=356, ProcessCount=170, AvailableMemoryMB=9120
2023-09-05 09:53:12,184 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-05 09:53:12,185 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-05 09:53:12,196 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033954125:84 , srv1041045634:84 , srv118135321:84 , srv1221555397:84 , srv1231020724:84 , srv1303365636:84 , srv130834857:84 , srv1334627120:84 , srv14381679:84 , srv1630452822:84 , srv1641690905:84 , srv1818479343:84 , srv1828655387:84 , srv1847771134:84 , srv1865896551:84 , srv1885315311:84 , srv1914038307:84 , srv1929078060:84 , srv1964677315:84 , srv2002036218:84 , srv2013034385:84 , srv27379818:84 , srv284426286:84 , srv361164712:84 , srv398568798:84 , srv560126163:84 , srv621086125:84 , srv702225217:84 , srv848784232:84 , srv1672947373:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-05 09:53:12,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:53:12,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv361164712=24, srv1303365636=5, srv2013034385=21, srv14381679=8, srv130834857=6, srv1885315311=16, srv2002036218=20, srv118135321=2, srv1033954125=0, srv1847771134=14, srv1914038307=17, srv1818479343=12, srv398568798=25, srv1641690905=10, srv1630452822=9, srv1865896551=15, srv1964677315=19, srv1828655387=13, srv1929078060=18, srv1041045634=1, srv702225217=28, srv27379818=22, srv621086125=27, srv284426286=23, srv1672947373=11, srv1231020724=4, srv560126163=26, srv848784232=29, srv1334627120=7, srv1221555397=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:53:12,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:53:12,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-05 09:53:12,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.097729472125542, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:53:12,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912500985639787, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.097729472125542, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-05 09:55:12,210 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5738343 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912500985639787 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:55:12,218 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1033954125:90 , srv1041045634:90 , srv118135321:90 , srv1221555397:90 , srv1231020724:90 , srv1303365636:90 , srv130834857:90 , srv1334627120:90 , srv14381679:90 , srv1630452822:90 , srv1641690905:90 , srv1672947373:90 , srv1818479343:90 , srv1828655387:90 , srv1847771134:90 , srv1865896551:90 , srv1885315311:90 , srv1914038307:90 , srv1929078060:90 , srv1964677315:90 , srv2002036218:90 , srv2013034385:90 , srv27379818:90 , srv284426286:90 , srv361164712:90 , srv398568798:90 , srv560126163:90 , srv621086125:90 , srv702225217:90 , srv848784232:90 }
2023-09-05 09:55:12,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-05 09:55:12,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv361164712=24, srv1303365636=5, srv2013034385=21, srv14381679=8, srv130834857=6, srv1885315311=16, srv2002036218=20, srv118135321=2, srv1033954125=0, srv1847771134=14, srv1914038307=17, srv1818479343=12, srv398568798=25, srv1641690905=10, srv1630452822=9, srv1865896551=15, srv1964677315=19, srv1828655387=13, srv1929078060=18, srv1041045634=1, srv702225217=28, srv27379818=22, srv621086125=27, srv284426286=23, srv1672947373=11, srv1231020724=4, srv560126163=26, srv848784232=29, srv1334627120=7, srv1221555397=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-05 09:55:12,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-05 09:55:12,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-05 09:55:12,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-05 09:55:12,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-05 09:55:12,237 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1033954125:90 , srv1041045634:90 , srv118135321:90 , srv1221555397:90 , srv1231020724:90 , srv1303365636:90 , srv130834857:90 , srv1334627120:90 , srv14381679:90 , srv1630452822:90 , srv1641690905:90 , srv1672947373:90 , srv1818479343:90 , srv1828655387:90 , srv1847771134:90 , srv1865896551:90 , srv1885315311:90 , srv1914038307:90 , srv1929078060:90 , srv1964677315:90 , srv2002036218:90 , srv2013034385:90 , srv27379818:90 , srv284426286:90 , srv361164712:90 , srv398568798:90 , srv560126163:90 , srv621086125:90 , srv702225217:90 , srv848784232:90 }
2023-09-05 09:55:12,248 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=186 (was 356), ProcessCount=167 (was 170), AvailableMemoryMB=8370 (was 9120)