2023-03-11 15:54:14,652 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-11 15:54:14,952 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-11 15:54:15,080 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-11 15:54:15,138 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-11 15:54:15,145 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-11 15:54:15,157 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=169, AvailableMemoryMB=5185
2023-03-11 15:54:15,159 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-11 15:54:15,159 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-11 15:54:15,283 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003620923:84 , srv100489939:84 , srv1017160358:84 , srv1025228850:84 , srv1051348674:84 , srv106377812:84 , srv1064442599:84 , srv1066120714:84 , srv1086807901:84 , srv1089220637:84 , srv1091819787:84 , srv1095661047:84 , srv1096950651:84 , srv1099176142:84 , srv1121380532:84 , srv1122296884:84 , srv112781664:84 , srv1141033022:84 , srv1181616444:84 , srv1183940278:84 , srv1237981289:84 , srv1244606999:84 , srv1245411224:84 , srv1260273199:84 , srv127914617:84 , srv1280941499:84 , srv1321880502:84 , srv1335025976:84 , srv1340088314:84 , srv1342631392:84 , srv1345216064:84 , srv1385783037:84 , srv1386866319:84 , srv1394033873:84 , srv1410593600:84 , srv1416374982:84 , srv1416597069:84 , srv1425852516:84 , srv1438974632:84 , srv144804364:84 , srv1460720437:84 , srv1463907559:84 , srv1497350801:84 , srv1521866404:84 , srv1534350753:84 , srv1586161515:84 , srv1595943826:84 , srv1666405709:84 , srv1730297021:84 , srv1730630617:84 , srv174669058:84 , srv1762735316:84 , srv1780348533:84 , srv1792822749:84 , srv1809229215:84 , srv1811886197:84 , srv1841234106:84 , srv1853095376:84 , srv1907222960:84 , srv1913421511:84 , srv1924729727:84 , srv1933738988:84 , srv1947845234:84 , srv1947906570:84 , srv2001908118:84 , srv2024570850:84 , srv2024843643:84 , srv2087922372:84 , srv209224633:84 , srv2099398185:84 , srv2116971312:84 , srv251107606:84 , srv252938669:84 , srv274781252:84 , srv278544194:84 , srv322440497:84 , srv358893177:84 , srv393380191:84 , srv39374497:84 , srv404684334:84 , srv408066921:84 , srv439301022:84 , srv444265226:84 , srv484987311:84 , srv487638996:84 , srv491830159:84 , srv56161204:84 , srv608253691:84 , srv611683204:84 , srv616044870:84 , srv61702427:84 , srv66056613:84 , srv707303681:84 , srv759226813:84 , srv769629797:84 , srv813837315:84 , srv944896171:84 , srv980873742:84 , srv9916019:84 , srv282739782:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-11 15:54:15,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:54:15,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1017160358=2, srv1534350753=44, srv174669058=50, srv1853095376=57, srv1425852516=37, srv1416597069=36, srv491830159=86, srv1280941499=25, srv274781252=73, srv393380191=78, srv1907222960=58, srv1025228850=3, srv1730297021=48, srv759226813=94, srv1340088314=28, srv1089220637=9, srv439301022=82, srv1947845234=62, srv322440497=76, srv1416374982=35, srv1463907559=41, srv1181616444=18, srv1345216064=30, srv1086807901=8, srv106377812=5, srv1091819787=10, srv358893177=77, srv1095661047=11, srv2116971312=70, srv1762735316=51, srv144804364=39, srv484987311=84, srv1841234106=56, srv1394033873=33, srv1933738988=61, srv1099176142=13, srv608253691=88, srv1385783037=31, srv1924729727=60, srv1245411224=22, srv2024843643=66, srv209224633=68, srv1003620923=0, srv1244606999=21, srv2099398185=69, srv9916019=99, srv1438974632=38, srv1064442599=6, srv251107606=71, srv616044870=90, srv1121380532=14, srv1122296884=15, srv408066921=81, srv1497350801=42, srv1335025976=27, srv1792822749=53, srv1342631392=29, srv39374497=79, srv2024570850=65, srv1666405709=47, srv1237981289=20, srv980873742=98, srv278544194=74, srv404684334=80, srv56161204=87, srv1260273199=23, srv100489939=1, srv707303681=93, srv1321880502=26, srv1811886197=55, srv127914617=24, srv1410593600=34, srv444265226=83, srv611683204=89, srv2087922372=67, srv252938669=72, srv1096950651=12, srv112781664=16, srv1141033022=17, srv1521866404=43, srv282739782=75, srv1730630617=49, srv813837315=96, srv1595943826=46, srv487638996=85, srv1780348533=52, srv1051348674=4, srv1586161515=45, srv1460720437=40, srv66056613=92, srv1066120714=7, srv769629797=95, srv944896171=97, srv1183940278=19, srv61702427=91, srv1947906570=63, srv1809229215=54, srv2001908118=64, srv1913421511=59, srv1386866319=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:54:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:54:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:54:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:54:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-11 15:54:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-11 15:54:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-11 15:54:15,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-11 15:54:15,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-11 15:54:15,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-11 15:54:15,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-11 15:54:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-11 15:54:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-11 15:54:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-11 15:54:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-11 15:54:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-11 15:54:15,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:15,570 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-11 15:54:15,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-11 15:54:15,954 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 560 ms to try 5000 different iterations.  Found a solution that moves 4690 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18336863238779633. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03869327103121612, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05237780391954538, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5211111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03869327103121612, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17841666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24758333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:15,975 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv707303681:81 , srv100489939:82 , srv1947906570:82 , srv1089220637:83 , srv1386866319:83 , srv1425852516:83 , srv1792822749:83 , srv1933738988:83 , srv2116971312:83 , srv393380191:83 , srv1086807901:84 , srv1091819787:84 , srv1141033022:84 , srv1181616444:84 , srv1340088314:84 , srv1342631392:84 , srv439301022:84 , srv491830159:84 , srv66056613:84 , srv1003620923:85 , srv1099176142:85 , srv1121380532:85 , srv1183940278:85 , srv1244606999:85 , srv1345216064:85 , srv1416597069:85 , srv1438974632:85 , srv1947845234:85 , srv2099398185:85 , srv322440497:85 , srv408066921:85 , srv759226813:85 , srv944896171:85 , srv1025228850:86 , srv1051348674:86 , srv1066120714:86 , srv1237981289:86 , srv1410593600:86 , srv1416374982:86 , srv1595943826:86 , srv1780348533:86 , srv1809229215:86 , srv1853095376:86 , srv274781252:86 , srv358893177:86 , srv611683204:86 , srv769629797:86 , srv813837315:86 , srv980873742:86 , srv9916019:86 , srv127914617:87 , srv1321880502:87 , srv1394033873:87 , srv144804364:87 , srv1460720437:87 , srv1463907559:87 , srv1497350801:87 , srv1586161515:87 , srv1666405709:87 , srv1730297021:87 , srv1841234106:87 , srv2001908118:87 , srv2024570850:87 , srv251107606:87 , srv278544194:87 , srv484987311:87 , srv608253691:87 , srv616044870:87 , srv106377812:88 , srv1064442599:88 , srv1095661047:88 , srv112781664:88 , srv1335025976:88 , srv1385783037:88 , srv1730630617:88 , srv1811886197:88 , srv1907222960:88 , srv1913421511:88 , srv1924729727:88 , srv1122296884:89 , srv1245411224:89 , srv1260273199:89 , srv1280941499:89 , srv1521866404:89 , srv1534350753:89 , srv2087922372:89 , srv487638996:89 , srv56161204:89 , srv174669058:90 , srv39374497:90 , srv404684334:90 , srv444265226:90 , srv61702427:90 , srv1017160358:91 , srv1096950651:91 , srv1762735316:91 , srv2024843643:91 , srv252938669:91 , srv209224633:92 , srv282739782:434 }
2023-03-11 15:54:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:54:15,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1017160358=2, srv1534350753=44, srv174669058=50, srv1853095376=57, srv1425852516=37, srv1416597069=36, srv491830159=86, srv1280941499=25, srv274781252=73, srv393380191=78, srv1907222960=58, srv1025228850=3, srv1730297021=48, srv759226813=94, srv1340088314=28, srv1089220637=9, srv439301022=82, srv1947845234=62, srv322440497=76, srv1416374982=35, srv1463907559=41, srv1181616444=18, srv1345216064=30, srv1086807901=8, srv106377812=5, srv1091819787=10, srv358893177=77, srv1095661047=11, srv2116971312=70, srv1762735316=51, srv144804364=39, srv484987311=84, srv1841234106=56, srv1394033873=33, srv1933738988=61, srv1099176142=13, srv608253691=88, srv1385783037=31, srv1924729727=60, srv1245411224=22, srv2024843643=66, srv209224633=68, srv1003620923=0, srv1244606999=21, srv2099398185=69, srv9916019=99, srv1438974632=38, srv1064442599=6, srv251107606=71, srv616044870=90, srv1121380532=14, srv1122296884=15, srv408066921=81, srv1497350801=42, srv1335025976=27, srv1792822749=53, srv1342631392=29, srv39374497=79, srv2024570850=65, srv1666405709=47, srv1237981289=20, srv980873742=98, srv278544194=74, srv404684334=80, srv56161204=87, srv1260273199=23, srv100489939=1, srv707303681=93, srv1321880502=26, srv1811886197=55, srv127914617=24, srv1410593600=34, srv444265226=83, srv611683204=89, srv2087922372=67, srv252938669=72, srv1096950651=12, srv112781664=16, srv1141033022=17, srv1521866404=43, srv282739782=75, srv1730630617=49, srv813837315=96, srv1595943826=46, srv487638996=85, srv1780348533=52, srv1051348674=4, srv1586161515=45, srv1460720437=40, srv66056613=92, srv1066120714=7, srv769629797=95, srv944896171=97, srv1183940278=19, srv61702427=91, srv1947906570=63, srv1809229215=54, srv2001908118=64, srv1913421511=59, srv1386866319=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:54:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:54:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:54:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:54:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:54:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:54:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:54:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:54:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-11 15:54:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-11 15:54:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-11 15:54:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-11 15:54:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-11 15:54:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-11 15:54:16,168 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03869327103121612, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05237780391954538, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03869327103121612, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17841666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24758333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:16,168 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-11 15:54:16,168 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18333579230589114, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03869327103121612, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05237780391954538, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03869327103121612, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17841666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24758333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-11 15:54:16,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 475 ms to try 5000 different iterations.  Found a solution that moves 2717 regions; Going from a computed imbalance of 0.18333579230589114 to a new imbalance of 0.016071100663110478. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020581398502888596); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0273440892034436, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.3018888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020581398502888596); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04583333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:16,501 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1762735316:80 , srv209224633:80 , srv1017160358:81 , srv1245411224:81 , srv1521866404:81 , srv1534350753:81 , srv174669058:81 , srv2024843643:81 , srv252938669:81 , srv106377812:82 , srv1096950651:82 , srv39374497:82 , srv56161204:82 , srv1907222960:83 , srv2087922372:83 , srv404684334:83 , srv444265226:83 , srv487638996:83 , srv61702427:83 , srv1122296884:84 , srv1260273199:84 , srv1280941499:84 , srv1335025976:84 , srv1385783037:84 , srv1463907559:84 , srv1586161515:84 , srv1730630617:84 , srv1811886197:84 , srv1924729727:84 , srv1051348674:85 , srv1064442599:85 , srv112781664:85 , srv127914617:85 , srv1321880502:85 , srv1416374982:85 , srv1438974632:85 , srv144804364:85 , srv1595943826:85 , srv251107606:85 , srv358893177:85 , srv616044870:85 , srv759226813:85 , srv769629797:85 , srv980873742:85 , srv9916019:85 , srv1003620923:86 , srv1025228850:86 , srv1095661047:86 , srv1121380532:86 , srv1340088314:86 , srv1394033873:86 , srv1780348533:86 , srv1809229215:86 , srv1947845234:86 , srv2024570850:86 , srv274781252:86 , srv322440497:86 , srv484987311:86 , srv491830159:86 , srv608253691:86 , srv813837315:86 , srv944896171:86 , srv1066120714:87 , srv1183940278:87 , srv1237981289:87 , srv1345216064:87 , srv1460720437:87 , srv1497350801:87 , srv1730297021:87 , srv1841234106:87 , srv1853095376:87 , srv1913421511:87 , srv278544194:87 , srv408066921:87 , srv611683204:87 , srv1086807901:88 , srv1089220637:88 , srv1099176142:88 , srv1244606999:88 , srv1386866319:88 , srv1410593600:88 , srv1416597069:88 , srv1425852516:88 , srv1666405709:88 , srv1933738988:88 , srv2001908118:88 , srv2099398185:88 , srv66056613:88 , srv100489939:89 , srv1091819787:89 , srv1141033022:89 , srv1181616444:89 , srv1342631392:89 , srv1792822749:89 , srv439301022:89 , srv393380191:90 , srv1947906570:91 , srv2116971312:91 , srv707303681:92 , srv282739782:523 }
2023-03-11 15:54:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:54:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1017160358=2, srv1534350753=44, srv174669058=50, srv1853095376=57, srv1425852516=37, srv1416597069=36, srv491830159=86, srv1280941499=25, srv274781252=73, srv393380191=78, srv1907222960=58, srv1025228850=3, srv1730297021=48, srv759226813=94, srv1340088314=28, srv1089220637=9, srv439301022=82, srv1947845234=62, srv322440497=76, srv1416374982=35, srv1463907559=41, srv1181616444=18, srv1345216064=30, srv1086807901=8, srv106377812=5, srv1091819787=10, srv358893177=77, srv1095661047=11, srv2116971312=70, srv1762735316=51, srv144804364=39, srv484987311=84, srv1841234106=56, srv1394033873=33, srv1933738988=61, srv1099176142=13, srv608253691=88, srv1385783037=31, srv1924729727=60, srv1245411224=22, srv2024843643=66, srv209224633=68, srv1003620923=0, srv1244606999=21, srv2099398185=69, srv9916019=99, srv1438974632=38, srv1064442599=6, srv251107606=71, srv616044870=90, srv1121380532=14, srv1122296884=15, srv408066921=81, srv1497350801=42, srv1335025976=27, srv1792822749=53, srv1342631392=29, srv39374497=79, srv2024570850=65, srv1666405709=47, srv1237981289=20, srv980873742=98, srv278544194=74, srv404684334=80, srv56161204=87, srv1260273199=23, srv100489939=1, srv707303681=93, srv1321880502=26, srv1811886197=55, srv127914617=24, srv1410593600=34, srv444265226=83, srv611683204=89, srv2087922372=67, srv252938669=72, srv1096950651=12, srv112781664=16, srv1141033022=17, srv1521866404=43, srv282739782=75, srv1730630617=49, srv813837315=96, srv1595943826=46, srv487638996=85, srv1780348533=52, srv1051348674=4, srv1586161515=45, srv1460720437=40, srv66056613=92, srv1066120714=7, srv769629797=95, srv944896171=97, srv1183940278=19, srv61702427=91, srv1947906570=63, srv1809229215=54, srv2001908118=64, srv1913421511=59, srv1386866319=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:54:16,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-11 15:54:16,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-11 15:54:16,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-11 15:54:16,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-11 15:54:16,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-11 15:54:16,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-11 15:54:16,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-11 15:54:16,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-11 15:54:16,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-11 15:54:16,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-11 15:54:16,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-11 15:54:16,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020581398502888596); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0273440892034436, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020581398502888596); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04583333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:16,686 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-11 15:54:16,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016052075822484406, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020581398502888596); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0273440892034436, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020581398502888596); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04583333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-11 15:54:16,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 374 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.016052075822484406 to a new imbalance of 7.786144818537418E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007221574692546627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00704323668071124); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007221574692546627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:16,930 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1666405709:82 , srv1913421511:82 , srv1122296884:83 , srv1141033022:83 , srv1410593600:83 , srv1497350801:83 , srv1841234106:83 , srv2001908118:83 , srv2099398185:83 , srv2116971312:83 , srv1095661047:84 , srv1096950651:84 , srv1237981289:84 , srv1260273199:84 , srv127914617:84 , srv1342631392:84 , srv1345216064:84 , srv1416597069:84 , srv1460720437:84 , srv1730297021:84 , srv1792822749:84 , srv1853095376:84 , srv278544194:84 , srv404684334:84 , srv439301022:84 , srv444265226:84 , srv611683204:84 , srv61702427:84 , srv1025228850:85 , srv1064442599:85 , srv1066120714:85 , srv1091819787:85 , srv112781664:85 , srv1181616444:85 , srv1183940278:85 , srv1244606999:85 , srv1280941499:85 , srv1321880502:85 , srv1335025976:85 , srv1385783037:85 , srv1394033873:85 , srv1730630617:85 , srv1780348533:85 , srv1809229215:85 , srv1924729727:85 , srv1947906570:85 , srv2024570850:85 , srv2087922372:85 , srv209224633:85 , srv252938669:85 , srv274781252:85 , srv358893177:85 , srv393380191:85 , srv39374497:85 , srv408066921:85 , srv484987311:85 , srv608253691:85 , srv66056613:85 , srv707303681:85 , srv769629797:85 , srv813837315:85 , srv1003620923:86 , srv100489939:86 , srv1017160358:86 , srv1051348674:86 , srv1086807901:86 , srv1099176142:86 , srv1121380532:86 , srv1386866319:86 , srv1416374982:86 , srv1425852516:86 , srv144804364:86 , srv1586161515:86 , srv174669058:86 , srv1762735316:86 , srv1811886197:86 , srv1933738988:86 , srv2024843643:86 , srv251107606:86 , srv487638996:86 , srv56161204:86 , srv616044870:86 , srv980873742:86 , srv9916019:86 , srv1089220637:87 , srv1245411224:87 , srv1463907559:87 , srv1534350753:87 , srv1595943826:87 , srv1907222960:87 , srv1947845234:87 , srv322440497:87 , srv759226813:87 , srv944896171:87 , srv106377812:88 , srv1340088314:88 , srv1438974632:88 , srv1521866404:89 , srv491830159:89 , srv282739782:565 }
2023-03-11 15:54:16,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:54:16,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1017160358=2, srv1534350753=44, srv174669058=50, srv1853095376=57, srv1425852516=37, srv1416597069=36, srv491830159=86, srv1280941499=25, srv274781252=73, srv393380191=78, srv1907222960=58, srv1025228850=3, srv1730297021=48, srv759226813=94, srv1340088314=28, srv1089220637=9, srv439301022=82, srv1947845234=62, srv322440497=76, srv1416374982=35, srv1463907559=41, srv1181616444=18, srv1345216064=30, srv1086807901=8, srv106377812=5, srv1091819787=10, srv358893177=77, srv1095661047=11, srv2116971312=70, srv1762735316=51, srv144804364=39, srv484987311=84, srv1841234106=56, srv1394033873=33, srv1933738988=61, srv1099176142=13, srv608253691=88, srv1385783037=31, srv1924729727=60, srv1245411224=22, srv2024843643=66, srv209224633=68, srv1003620923=0, srv1244606999=21, srv2099398185=69, srv9916019=99, srv1438974632=38, srv1064442599=6, srv251107606=71, srv616044870=90, srv1121380532=14, srv1122296884=15, srv408066921=81, srv1497350801=42, srv1335025976=27, srv1792822749=53, srv1342631392=29, srv39374497=79, srv2024570850=65, srv1666405709=47, srv1237981289=20, srv980873742=98, srv278544194=74, srv404684334=80, srv56161204=87, srv1260273199=23, srv100489939=1, srv707303681=93, srv1321880502=26, srv1811886197=55, srv127914617=24, srv1410593600=34, srv444265226=83, srv611683204=89, srv2087922372=67, srv252938669=72, srv1096950651=12, srv112781664=16, srv1141033022=17, srv1521866404=43, srv282739782=75, srv1730630617=49, srv813837315=96, srv1595943826=46, srv487638996=85, srv1780348533=52, srv1051348674=4, srv1586161515=45, srv1460720437=40, srv66056613=92, srv1066120714=7, srv769629797=95, srv944896171=97, srv1183940278=19, srv61702427=91, srv1947906570=63, srv1809229215=54, srv2001908118=64, srv1913421511=59, srv1386866319=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:54:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:54:16,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:54:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-11 15:54:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-11 15:54:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-11 15:54:16,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-11 15:54:16,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-11 15:54:16,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-11 15:54:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-11 15:54:16,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-11 15:54:17,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007221574692546627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00704323668071124); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007221574692546627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:17,093 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-11 15:54:17,094 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.717033601393753E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007221574692546627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00704323668071124); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007221574692546627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-11 15:54:17,437 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 475 ms to try 5000 different iterations.  Found a solution that moves 245 regions; Going from a computed imbalance of 7.717033601393753E-4 to a new imbalance of 2.027126611915502E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02722222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:17,438 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1521866404:82 , srv1066120714:83 , srv1099176142:83 , srv1438974632:83 , srv1811886197:83 , srv491830159:83 , srv1017160358:84 , srv1064442599:84 , srv1086807901:84 , srv1089220637:84 , srv1091819787:84 , srv1095661047:84 , srv112781664:84 , srv1181616444:84 , srv1183940278:84 , srv1244606999:84 , srv1280941499:84 , srv1335025976:84 , srv1340088314:84 , srv1385783037:84 , srv1394033873:84 , srv144804364:84 , srv1460720437:84 , srv1463907559:84 , srv1595943826:84 , srv1730297021:84 , srv1762735316:84 , srv1907222960:84 , srv1947845234:84 , srv1947906570:84 , srv2001908118:84 , srv2024570850:84 , srv251107606:84 , srv278544194:84 , srv322440497:84 , srv444265226:84 , srv484987311:84 , srv487638996:84 , srv608253691:84 , srv616044870:84 , srv707303681:84 , srv944896171:84 , srv9916019:84 , srv1003620923:85 , srv100489939:85 , srv1025228850:85 , srv1051348674:85 , srv106377812:85 , srv1096950651:85 , srv1121380532:85 , srv1122296884:85 , srv1237981289:85 , srv1245411224:85 , srv1260273199:85 , srv1321880502:85 , srv1342631392:85 , srv1386866319:85 , srv1416374982:85 , srv1416597069:85 , srv1425852516:85 , srv1497350801:85 , srv1534350753:85 , srv1586161515:85 , srv1666405709:85 , srv1730630617:85 , srv174669058:85 , srv1809229215:85 , srv1853095376:85 , srv1913421511:85 , srv1924729727:85 , srv2024843643:85 , srv2087922372:85 , srv2116971312:85 , srv252938669:85 , srv274781252:85 , srv393380191:85 , srv39374497:85 , srv404684334:85 , srv408066921:85 , srv439301022:85 , srv56161204:85 , srv611683204:85 , srv61702427:85 , srv66056613:85 , srv759226813:85 , srv980873742:85 , srv1345216064:86 , srv1410593600:86 , srv1780348533:86 , srv1792822749:86 , srv1841234106:86 , srv1933738988:86 , srv209224633:86 , srv2099398185:86 , srv358893177:86 , srv769629797:86 , srv813837315:86 , srv1141033022:87 , srv127914617:87 , srv282739782:620 }
2023-03-11 15:54:17,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:54:17,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1017160358=2, srv1534350753=44, srv174669058=50, srv1853095376=57, srv1425852516=37, srv1416597069=36, srv491830159=86, srv1280941499=25, srv274781252=73, srv393380191=78, srv1907222960=58, srv1025228850=3, srv1730297021=48, srv759226813=94, srv1340088314=28, srv1089220637=9, srv439301022=82, srv1947845234=62, srv322440497=76, srv1416374982=35, srv1463907559=41, srv1181616444=18, srv1345216064=30, srv1086807901=8, srv106377812=5, srv1091819787=10, srv358893177=77, srv1095661047=11, srv2116971312=70, srv1762735316=51, srv144804364=39, srv484987311=84, srv1841234106=56, srv1394033873=33, srv1933738988=61, srv1099176142=13, srv608253691=88, srv1385783037=31, srv1924729727=60, srv1245411224=22, srv2024843643=66, srv209224633=68, srv1003620923=0, srv1244606999=21, srv2099398185=69, srv9916019=99, srv1438974632=38, srv1064442599=6, srv251107606=71, srv616044870=90, srv1121380532=14, srv1122296884=15, srv408066921=81, srv1497350801=42, srv1335025976=27, srv1792822749=53, srv1342631392=29, srv39374497=79, srv2024570850=65, srv1666405709=47, srv1237981289=20, srv980873742=98, srv278544194=74, srv404684334=80, srv56161204=87, srv1260273199=23, srv100489939=1, srv707303681=93, srv1321880502=26, srv1811886197=55, srv127914617=24, srv1410593600=34, srv444265226=83, srv611683204=89, srv2087922372=67, srv252938669=72, srv1096950651=12, srv112781664=16, srv1141033022=17, srv1521866404=43, srv282739782=75, srv1730630617=49, srv813837315=96, srv1595943826=46, srv487638996=85, srv1780348533=52, srv1051348674=4, srv1586161515=45, srv1460720437=40, srv66056613=92, srv1066120714=7, srv769629797=95, srv944896171=97, srv1183940278=19, srv61702427=91, srv1947906570=63, srv1809229215=54, srv2001908118=64, srv1913421511=59, srv1386866319=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:54:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:54:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-11 15:54:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-11 15:54:17,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-11 15:54:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-11 15:54:17,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-11 15:54:17,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-11 15:54:17,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.8555739452468344E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:17,574 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1521866404:82 , srv1066120714:83 , srv1099176142:83 , srv1438974632:83 , srv1811886197:83 , srv491830159:83 , srv1017160358:84 , srv1064442599:84 , srv1086807901:84 , srv1089220637:84 , srv1091819787:84 , srv1095661047:84 , srv112781664:84 , srv1181616444:84 , srv1183940278:84 , srv1244606999:84 , srv1280941499:84 , srv1335025976:84 , srv1340088314:84 , srv1385783037:84 , srv1394033873:84 , srv144804364:84 , srv1460720437:84 , srv1463907559:84 , srv1595943826:84 , srv1730297021:84 , srv1762735316:84 , srv1907222960:84 , srv1947845234:84 , srv1947906570:84 , srv2001908118:84 , srv2024570850:84 , srv251107606:84 , srv278544194:84 , srv322440497:84 , srv444265226:84 , srv484987311:84 , srv487638996:84 , srv608253691:84 , srv616044870:84 , srv707303681:84 , srv944896171:84 , srv9916019:84 , srv1003620923:85 , srv100489939:85 , srv1025228850:85 , srv1051348674:85 , srv106377812:85 , srv1096950651:85 , srv1121380532:85 , srv1122296884:85 , srv1237981289:85 , srv1245411224:85 , srv1260273199:85 , srv1321880502:85 , srv1342631392:85 , srv1386866319:85 , srv1416374982:85 , srv1416597069:85 , srv1425852516:85 , srv1497350801:85 , srv1534350753:85 , srv1586161515:85 , srv1666405709:85 , srv1730630617:85 , srv174669058:85 , srv1809229215:85 , srv1853095376:85 , srv1913421511:85 , srv1924729727:85 , srv2024843643:85 , srv2087922372:85 , srv2116971312:85 , srv252938669:85 , srv274781252:85 , srv393380191:85 , srv39374497:85 , srv404684334:85 , srv408066921:85 , srv439301022:85 , srv56161204:85 , srv611683204:85 , srv61702427:85 , srv66056613:85 , srv759226813:85 , srv980873742:85 , srv1345216064:86 , srv1410593600:86 , srv1780348533:86 , srv1792822749:86 , srv1841234106:86 , srv1933738988:86 , srv209224633:86 , srv2099398185:86 , srv358893177:86 , srv769629797:86 , srv813837315:86 , srv1141033022:87 , srv127914617:87 , srv282739782:620 }
2023-03-11 15:54:17,606 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 274), ProcessCount=169 (was 169), AvailableMemoryMB=4696 (was 5185)
2023-03-11 15:54:17,613 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=169, AvailableMemoryMB=4696
2023-03-11 15:54:17,614 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-11 15:54:17,614 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-11 15:54:17,622 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1039900157:84 , srv1101372305:84 , srv1153754653:84 , srv1223812733:84 , srv1234523598:84 , srv1322771547:84 , srv1399675054:84 , srv1502378728:84 , srv1523631959:84 , srv1619605452:84 , srv1920806227:84 , srv1976578164:84 , srv2127927061:84 , srv2138730652:84 , srv218144326:84 , srv275459794:84 , srv370309193:84 , srv415003756:84 , srv436873095:84 , srv479321138:84 , srv502577822:84 , srv568706675:84 , srv718533131:84 , srv731375448:84 , srv767206882:84 , srv775523420:84 , srv800127222:84 , srv832278167:84 , srv930898150:84 , srv492569936:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-11 15:54:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:54:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv832278167=28, srv731375448=24, srv415003756=17, srv502577822=21, srv568706675=22, srv1399675054=6, srv2127927061=12, srv479321138=19, srv218144326=14, srv800127222=27, srv1153754653=2, srv1039900157=0, srv2138730652=13, srv1523631959=8, srv275459794=15, srv930898150=29, srv1322771547=5, srv492569936=20, srv1234523598=4, srv718533131=23, srv767206882=25, srv1619605452=9, srv1976578164=11, srv1502378728=7, srv1920806227=10, srv1223812733=3, srv370309193=16, srv436873095=18, srv1101372305=1, srv775523420=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:54:17,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:54:17,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:54:17,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:54:17,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-11 15:54:17,647 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1496179116915968, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:54:17,648 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912664484418545, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1496179116915968, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-11 15:56:17,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6157735 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.9912664484418545 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:56:17,642 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039900157:90 , srv1101372305:90 , srv1153754653:90 , srv1223812733:90 , srv1234523598:90 , srv1322771547:90 , srv1399675054:90 , srv1502378728:90 , srv1523631959:90 , srv1619605452:90 , srv1920806227:90 , srv1976578164:90 , srv2127927061:90 , srv2138730652:90 , srv218144326:90 , srv275459794:90 , srv370309193:90 , srv415003756:90 , srv436873095:90 , srv479321138:90 , srv492569936:90 , srv502577822:90 , srv568706675:90 , srv718533131:90 , srv731375448:90 , srv767206882:90 , srv775523420:90 , srv800127222:90 , srv832278167:90 , srv930898150:90 }
2023-03-11 15:56:17,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-11 15:56:17,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv832278167=28, srv731375448=24, srv415003756=17, srv502577822=21, srv568706675=22, srv1399675054=6, srv2127927061=12, srv479321138=19, srv218144326=14, srv800127222=27, srv1153754653=2, srv1039900157=0, srv2138730652=13, srv1523631959=8, srv275459794=15, srv930898150=29, srv1322771547=5, srv492569936=20, srv1234523598=4, srv718533131=23, srv767206882=25, srv1619605452=9, srv1976578164=11, srv1502378728=7, srv1920806227=10, srv1223812733=3, srv370309193=16, srv436873095=18, srv1101372305=1, srv775523420=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-11 15:56:17,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-11 15:56:17,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-11 15:56:17,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-11 15:56:17,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-11 15:56:17,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-11 15:56:17,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-11 15:56:17,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-11 15:56:17,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-11 15:56:17,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-11 15:56:17,660 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-11 15:56:17,660 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1039900157:90 , srv1101372305:90 , srv1153754653:90 , srv1223812733:90 , srv1234523598:90 , srv1322771547:90 , srv1399675054:90 , srv1502378728:90 , srv1523631959:90 , srv1619605452:90 , srv1920806227:90 , srv1976578164:90 , srv2127927061:90 , srv2138730652:90 , srv218144326:90 , srv275459794:90 , srv370309193:90 , srv415003756:90 , srv436873095:90 , srv479321138:90 , srv492569936:90 , srv502577822:90 , srv568706675:90 , srv718533131:90 , srv731375448:90 , srv767206882:90 , srv775523420:90 , srv800127222:90 , srv832278167:90 , srv930898150:90 }
2023-03-11 15:56:17,672 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 274), ProcessCount=169 (was 169), AvailableMemoryMB=4401 (was 4696)