2023-07-19 00:53:11,860 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-19 00:53:12,176 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-19 00:53:12,286 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-19 00:53:12,354 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-19 00:53:12,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-19 00:53:12,384 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=175, AvailableMemoryMB=7314
2023-07-19 00:53:12,386 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-19 00:53:12,386 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-19 00:53:12,528 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012066850:84 , srv1012856079:84 , srv1038246041:84 , srv1046587324:84 , srv1061346337:84 , srv1108982846:84 , srv1137718279:84 , srv1143731259:84 , srv1158842735:84 , srv1168065335:84 , srv1177560631:84 , srv1205482360:84 , srv1222477424:84 , srv124120446:84 , srv1292599932:84 , srv1309676368:84 , srv1345257408:84 , srv1346083401:84 , srv1348562420:84 , srv137567517:84 , srv1376877346:84 , srv1435813542:84 , srv1440261942:84 , srv1450787801:84 , srv1470887982:84 , srv1497084693:84 , srv1520264194:84 , srv1542732375:84 , srv1568317382:84 , srv1667187878:84 , srv1679442957:84 , srv1743632775:84 , srv1762251362:84 , srv1767912572:84 , srv1778603062:84 , srv1832885664:84 , srv1835475125:84 , srv1840157043:84 , srv1845401072:84 , srv1865630076:84 , srv1865644332:84 , srv1879729705:84 , srv190147403:84 , srv1916306106:84 , srv1934244933:84 , srv1951058558:84 , srv19534600:84 , srv199922443:84 , srv2001173761:84 , srv2024989742:84 , srv2102573469:84 , srv2124200187:84 , srv2138742991:84 , srv2142371036:84 , srv221970897:84 , srv251466715:84 , srv298493798:84 , srv302264850:84 , srv33137216:84 , srv331654951:84 , srv3411864:84 , srv349268522:84 , srv390124255:84 , srv398109448:84 , srv426102220:84 , srv431730336:84 , srv442994704:84 , srv479843144:84 , srv48041494:84 , srv480617407:84 , srv53104733:84 , srv588773107:84 , srv598249846:84 , srv627351319:84 , srv62969819:84 , srv640080506:84 , srv679715972:84 , srv694126588:84 , srv697111275:84 , srv711964727:84 , srv730411750:84 , srv732925134:84 , srv746192035:84 , srv746336153:84 , srv759546862:84 , srv775857279:84 , srv776412597:84 , srv806979878:84 , srv807537548:84 , srv816682416:84 , srv839467521:84 , srv85565136:84 , srv866401549:84 , srv877462016:84 , srv892525838:84 , srv906152715:84 , srv916054832:84 , srv949306920:84 , srv98392959:84 , srv1982506489:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-19 00:53:12,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:53:12,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892525838=95, srv1542732375=27, srv53104733=71, srv199922443=48, srv19534600=46, srv48041494=69, srv1143731259=7, srv1865644332=40, srv221970897=55, srv1158842735=8, srv807537548=89, srv1497084693=25, srv62969819=75, srv1435813542=21, srv1667187878=29, srv1982506489=47, srv775857279=86, srv331654951=60, srv480617407=70, srv1038246041=2, srv746192035=83, srv2024989742=50, srv426102220=65, srv2142371036=54, srv85565136=92, srv1061346337=4, srv1292599932=14, srv839467521=91, srv730411750=81, srv1205482360=11, srv137567517=19, srv190147403=42, srv1348562420=18, srv1345257408=16, srv1679442957=30, srv598249846=73, srv479843144=68, srv711964727=80, srv816682416=90, srv1376877346=20, srv1440261942=22, srv1865630076=39, srv1832885664=35, srv1470887982=24, srv2001173761=49, srv431730336=66, srv1137718279=6, srv1934244933=44, srv697111275=79, srv746336153=84, srv1743632775=31, srv1879729705=41, srv877462016=94, srv1168065335=9, srv33137216=59, srv251466715=56, srv398109448=64, srv949306920=98, srv640080506=76, srv1520264194=26, srv1450787801=23, srv1845401072=38, srv442994704=67, srv1568317382=28, srv759546862=85, srv3411864=61, srv588773107=72, srv806979878=88, srv349268522=62, srv2124200187=52, srv1951058558=45, srv1046587324=3, srv302264850=58, srv627351319=74, srv1012856079=1, srv1916306106=43, srv916054832=97, srv124120446=13, srv1012066850=0, srv2138742991=53, srv298493798=57, srv906152715=96, srv1762251362=32, srv1778603062=34, srv1108982846=5, srv694126588=78, srv390124255=63, srv98392959=99, srv1177560631=10, srv679715972=77, srv1840157043=37, srv1222477424=12, srv1835475125=36, srv2102573469=51, srv732925134=82, srv1346083401=17, srv1309676368=15, srv776412597=87, srv866401549=93, srv1767912572=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 00:53:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 00:53:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 00:53:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 00:53:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 00:53:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 00:53:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 00:53:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 00:53:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 00:53:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 00:53:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 00:53:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 00:53:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 00:53:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 00:53:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 00:53:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 00:53:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 00:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 00:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 00:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 00:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 00:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 00:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 00:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 00:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 00:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 00:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 00:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 00:53:12,831 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:12,831 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 00:53:12,831 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 00:53:13,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 514 ms to try 5000 different iterations.  Found a solution that moves 4673 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18220857011039776. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03931163522321581, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055696790172017716, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5192222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03931163522321581, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17741666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:13,213 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1440261942:81 , srv588773107:81 , srv694126588:81 , srv1762251362:82 , srv1835475125:82 , srv190147403:82 , srv730411750:82 , srv892525838:82 , srv1012066850:83 , srv1292599932:83 , srv1470887982:83 , srv1679442957:83 , srv1916306106:83 , srv426102220:83 , srv480617407:83 , srv1158842735:84 , srv1832885664:84 , srv1865644332:84 , srv1879729705:84 , srv1951058558:84 , srv3411864:84 , srv398109448:84 , srv640080506:84 , srv759546862:84 , srv85565136:84 , srv1038246041:85 , srv1061346337:85 , srv1143731259:85 , srv1542732375:85 , srv1767912572:85 , srv19534600:85 , srv349268522:85 , srv48041494:85 , srv62969819:85 , srv746336153:85 , srv98392959:85 , srv1012856079:86 , srv1137718279:86 , srv124120446:86 , srv1376877346:86 , srv1450787801:86 , srv1840157043:86 , srv1845401072:86 , srv1865630076:86 , srv2001173761:86 , srv2124200187:86 , srv2138742991:86 , srv2142371036:86 , srv298493798:86 , srv442994704:86 , srv711964727:86 , srv732925134:86 , srv806979878:86 , srv906152715:86 , srv916054832:86 , srv949306920:86 , srv1497084693:87 , srv1520264194:87 , srv199922443:87 , srv251466715:87 , srv302264850:87 , srv679715972:87 , srv1046587324:88 , srv1168065335:88 , srv1205482360:88 , srv1222477424:88 , srv1345257408:88 , srv1346083401:88 , srv1348562420:88 , srv137567517:88 , srv1568317382:88 , srv1778603062:88 , srv2102573469:88 , srv221970897:88 , srv33137216:88 , srv390124255:88 , srv479843144:88 , srv53104733:88 , srv775857279:88 , srv776412597:88 , srv807537548:88 , srv1435813542:89 , srv1743632775:89 , srv2024989742:89 , srv839467521:89 , srv866401549:89 , srv877462016:89 , srv1177560631:90 , srv1667187878:90 , srv1934244933:90 , srv331654951:90 , srv431730336:90 , srv598249846:91 , srv627351319:91 , srv1309676368:92 , srv1108982846:93 , srv697111275:94 , srv816682416:94 , srv746192035:99 , srv1982506489:439 }
2023-07-19 00:53:13,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:53:13,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892525838=95, srv1542732375=27, srv53104733=71, srv199922443=48, srv19534600=46, srv48041494=69, srv1143731259=7, srv1865644332=40, srv221970897=55, srv1158842735=8, srv807537548=89, srv1497084693=25, srv62969819=75, srv1435813542=21, srv1667187878=29, srv1982506489=47, srv775857279=86, srv331654951=60, srv480617407=70, srv1038246041=2, srv746192035=83, srv2024989742=50, srv426102220=65, srv2142371036=54, srv85565136=92, srv1061346337=4, srv1292599932=14, srv839467521=91, srv730411750=81, srv1205482360=11, srv137567517=19, srv190147403=42, srv1348562420=18, srv1345257408=16, srv1679442957=30, srv598249846=73, srv479843144=68, srv711964727=80, srv816682416=90, srv1376877346=20, srv1440261942=22, srv1865630076=39, srv1832885664=35, srv1470887982=24, srv2001173761=49, srv431730336=66, srv1137718279=6, srv1934244933=44, srv697111275=79, srv746336153=84, srv1743632775=31, srv1879729705=41, srv877462016=94, srv1168065335=9, srv33137216=59, srv251466715=56, srv398109448=64, srv949306920=98, srv640080506=76, srv1520264194=26, srv1450787801=23, srv1845401072=38, srv442994704=67, srv1568317382=28, srv759546862=85, srv3411864=61, srv588773107=72, srv806979878=88, srv349268522=62, srv2124200187=52, srv1951058558=45, srv1046587324=3, srv302264850=58, srv627351319=74, srv1012856079=1, srv1916306106=43, srv916054832=97, srv124120446=13, srv1012066850=0, srv2138742991=53, srv298493798=57, srv906152715=96, srv1762251362=32, srv1778603062=34, srv1108982846=5, srv694126588=78, srv390124255=63, srv98392959=99, srv1177560631=10, srv679715972=77, srv1840157043=37, srv1222477424=12, srv1835475125=36, srv2102573469=51, srv732925134=82, srv1346083401=17, srv1309676368=15, srv776412597=87, srv866401549=93, srv1767912572=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:53:13,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:53:13,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:53:13,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:53:13,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:53:13,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:53:13,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:53:13,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 00:53:13,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 00:53:13,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 00:53:13,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 00:53:13,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 00:53:13,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 00:53:13,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 00:53:13,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 00:53:13,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 00:53:13,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 00:53:13,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03931163522321581, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055696790172017716, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03931163522321581, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17741666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:13,451 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 00:53:13,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18217584906503684, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03931163522321581, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055696790172017716, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03931163522321581, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17741666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 00:53:13,799 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 513 ms to try 5000 different iterations.  Found a solution that moves 2638 regions; Going from a computed imbalance of 0.18217584906503684 to a new imbalance of 0.015578120097073527. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02306212974029338); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03362832433427012, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2931111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02306212974029338); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:13,814 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv746192035:74 , srv816682416:77 , srv697111275:79 , srv1108982846:80 , srv598249846:80 , srv1667187878:81 , srv1743632775:81 , srv221970897:81 , srv627351319:81 , srv1309676368:82 , srv1345257408:82 , srv1346083401:82 , srv431730336:82 , srv53104733:82 , srv866401549:82 , srv877462016:82 , srv1046587324:83 , srv1177560631:83 , srv137567517:83 , srv1376877346:83 , srv1568317382:83 , srv33137216:83 , srv679715972:83 , srv775857279:83 , srv1205482360:84 , srv1222477424:84 , srv1348562420:84 , srv1435813542:84 , srv1520264194:84 , srv199922443:84 , srv2102573469:84 , srv2138742991:84 , srv251466715:84 , srv298493798:84 , srv331654951:84 , srv442994704:84 , srv776412597:84 , srv806979878:84 , srv1137718279:85 , srv1168065335:85 , srv1934244933:85 , srv2024989742:85 , srv302264850:85 , srv390124255:85 , srv62969819:85 , srv839467521:85 , srv1038246041:86 , srv1143731259:86 , srv124120446:86 , srv1542732375:86 , srv1767912572:86 , srv1778603062:86 , srv1840157043:86 , srv1951058558:86 , srv349268522:86 , srv480617407:86 , srv640080506:86 , srv807537548:86 , srv906152715:86 , srv916054832:86 , srv1012856079:87 , srv1450787801:87 , srv1497084693:87 , srv1832885664:87 , srv1845401072:87 , srv1865630076:87 , srv1865644332:87 , srv1879729705:87 , srv2001173761:87 , srv2124200187:87 , srv2142371036:87 , srv479843144:87 , srv48041494:87 , srv711964727:87 , srv746336153:87 , srv1012066850:88 , srv1470887982:88 , srv19534600:88 , srv3411864:88 , srv588773107:88 , srv732925134:88 , srv759546862:88 , srv949306920:88 , srv98392959:88 , srv1061346337:89 , srv1158842735:89 , srv1292599932:89 , srv1679442957:89 , srv190147403:89 , srv398109448:89 , srv85565136:89 , srv892525838:90 , srv1440261942:91 , srv1835475125:91 , srv1916306106:91 , srv426102220:91 , srv694126588:91 , srv730411750:91 , srv1762251362:92 , srv1982506489:540 }
2023-07-19 00:53:13,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:53:13,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892525838=95, srv1542732375=27, srv53104733=71, srv199922443=48, srv19534600=46, srv48041494=69, srv1143731259=7, srv1865644332=40, srv221970897=55, srv1158842735=8, srv807537548=89, srv1497084693=25, srv62969819=75, srv1435813542=21, srv1667187878=29, srv1982506489=47, srv775857279=86, srv331654951=60, srv480617407=70, srv1038246041=2, srv746192035=83, srv2024989742=50, srv426102220=65, srv2142371036=54, srv85565136=92, srv1061346337=4, srv1292599932=14, srv839467521=91, srv730411750=81, srv1205482360=11, srv137567517=19, srv190147403=42, srv1348562420=18, srv1345257408=16, srv1679442957=30, srv598249846=73, srv479843144=68, srv711964727=80, srv816682416=90, srv1376877346=20, srv1440261942=22, srv1865630076=39, srv1832885664=35, srv1470887982=24, srv2001173761=49, srv431730336=66, srv1137718279=6, srv1934244933=44, srv697111275=79, srv746336153=84, srv1743632775=31, srv1879729705=41, srv877462016=94, srv1168065335=9, srv33137216=59, srv251466715=56, srv398109448=64, srv949306920=98, srv640080506=76, srv1520264194=26, srv1450787801=23, srv1845401072=38, srv442994704=67, srv1568317382=28, srv759546862=85, srv3411864=61, srv588773107=72, srv806979878=88, srv349268522=62, srv2124200187=52, srv1951058558=45, srv1046587324=3, srv302264850=58, srv627351319=74, srv1012856079=1, srv1916306106=43, srv916054832=97, srv124120446=13, srv1012066850=0, srv2138742991=53, srv298493798=57, srv906152715=96, srv1762251362=32, srv1778603062=34, srv1108982846=5, srv694126588=78, srv390124255=63, srv98392959=99, srv1177560631=10, srv679715972=77, srv1840157043=37, srv1222477424=12, srv1835475125=36, srv2102573469=51, srv732925134=82, srv1346083401=17, srv1309676368=15, srv776412597=87, srv866401549=93, srv1767912572=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 00:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 00:53:13,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 00:53:13,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 00:53:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 00:53:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 00:53:13,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 00:53:13,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 00:53:14,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02306212974029338); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03362832433427012, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02306212974029338); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:14,025 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 00:53:14,025 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015559648426270592, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02306212974029338); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03362832433427012, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02306212974029338); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 00:53:14,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 488 ms to try 5000 different iterations.  Found a solution that moves 977 regions; Going from a computed imbalance of 0.015559648426270592 to a new imbalance of 4.714319829861685E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005206785216983458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0076394627883592066); MoveCostFunction : (multiplier=7.0, imbalance=0.10855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005206785216983458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:14,367 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv479843144:82 , srv1309676368:83 , srv1778603062:83 , srv1934244933:83 , srv2024989742:83 , srv807537548:83 , srv1012856079:84 , srv1061346337:84 , srv1158842735:84 , srv1177560631:84 , srv1435813542:84 , srv1450787801:84 , srv1497084693:84 , srv1762251362:84 , srv1865630076:84 , srv1916306106:84 , srv2124200187:84 , srv2142371036:84 , srv331654951:84 , srv426102220:84 , srv697111275:84 , srv730411750:84 , srv732925134:84 , srv746192035:84 , srv839467521:84 , srv949306920:84 , srv98392959:84 , srv1108982846:85 , srv1205482360:85 , srv1679442957:85 , srv1835475125:85 , srv1840157043:85 , srv1845401072:85 , srv19534600:85 , srv2001173761:85 , srv302264850:85 , srv390124255:85 , srv431730336:85 , srv627351319:85 , srv694126588:85 , srv711964727:85 , srv776412597:85 , srv85565136:85 , srv892525838:85 , srv906152715:85 , srv1046587324:86 , srv1137718279:86 , srv1168065335:86 , srv1222477424:86 , srv124120446:86 , srv1292599932:86 , srv1345257408:86 , srv1348562420:86 , srv137567517:86 , srv1440261942:86 , srv1520264194:86 , srv1542732375:86 , srv1568317382:86 , srv1832885664:86 , srv1865644332:86 , srv1951058558:86 , srv199922443:86 , srv2102573469:86 , srv33137216:86 , srv3411864:86 , srv349268522:86 , srv398109448:86 , srv48041494:86 , srv746336153:86 , srv759546862:86 , srv775857279:86 , srv816682416:86 , srv877462016:86 , srv1012066850:87 , srv1038246041:87 , srv1143731259:87 , srv1667187878:87 , srv1767912572:87 , srv1879729705:87 , srv190147403:87 , srv251466715:87 , srv53104733:87 , srv598249846:87 , srv640080506:87 , srv679715972:87 , srv806979878:87 , srv866401549:87 , srv916054832:87 , srv1346083401:88 , srv1470887982:88 , srv1743632775:88 , srv2138742991:88 , srv221970897:88 , srv298493798:88 , srv442994704:88 , srv62969819:88 , srv1376877346:89 , srv480617407:89 , srv588773107:89 , srv1982506489:525 }
2023-07-19 00:53:14,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:53:14,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892525838=95, srv1542732375=27, srv53104733=71, srv199922443=48, srv19534600=46, srv48041494=69, srv1143731259=7, srv1865644332=40, srv221970897=55, srv1158842735=8, srv807537548=89, srv1497084693=25, srv62969819=75, srv1435813542=21, srv1667187878=29, srv1982506489=47, srv775857279=86, srv331654951=60, srv480617407=70, srv1038246041=2, srv746192035=83, srv2024989742=50, srv426102220=65, srv2142371036=54, srv85565136=92, srv1061346337=4, srv1292599932=14, srv839467521=91, srv730411750=81, srv1205482360=11, srv137567517=19, srv190147403=42, srv1348562420=18, srv1345257408=16, srv1679442957=30, srv598249846=73, srv479843144=68, srv711964727=80, srv816682416=90, srv1376877346=20, srv1440261942=22, srv1865630076=39, srv1832885664=35, srv1470887982=24, srv2001173761=49, srv431730336=66, srv1137718279=6, srv1934244933=44, srv697111275=79, srv746336153=84, srv1743632775=31, srv1879729705=41, srv877462016=94, srv1168065335=9, srv33137216=59, srv251466715=56, srv398109448=64, srv949306920=98, srv640080506=76, srv1520264194=26, srv1450787801=23, srv1845401072=38, srv442994704=67, srv1568317382=28, srv759546862=85, srv3411864=61, srv588773107=72, srv806979878=88, srv349268522=62, srv2124200187=52, srv1951058558=45, srv1046587324=3, srv302264850=58, srv627351319=74, srv1012856079=1, srv1916306106=43, srv916054832=97, srv124120446=13, srv1012066850=0, srv2138742991=53, srv298493798=57, srv906152715=96, srv1762251362=32, srv1778603062=34, srv1108982846=5, srv694126588=78, srv390124255=63, srv98392959=99, srv1177560631=10, srv679715972=77, srv1840157043=37, srv1222477424=12, srv1835475125=36, srv2102573469=51, srv732925134=82, srv1346083401=17, srv1309676368=15, srv776412597=87, srv866401549=93, srv1767912572=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:53:14,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:53:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 00:53:14,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 00:53:14,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 00:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 00:53:14,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 00:53:14,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 00:53:14,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 00:53:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 00:53:14,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 00:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 00:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 00:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 00:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 00:53:14,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 00:53:14,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005206785216983458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0076394627883592066); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005206785216983458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:14,558 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 00:53:14,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.645908827684017E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005206785216983458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0076394627883592066); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005206785216983458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 00:53:14,887 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 227 regions; Going from a computed imbalance of 4.645908827684017E-4 to a new imbalance of 1.1432381011871267E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.025222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:14,888 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1168065335:83 , srv1470887982:83 , srv1916306106:83 , srv398109448:83 , srv916054832:83 , srv1012066850:84 , srv1038246041:84 , srv1061346337:84 , srv1108982846:84 , srv1143731259:84 , srv1222477424:84 , srv124120446:84 , srv1292599932:84 , srv1309676368:84 , srv1348562420:84 , srv1376877346:84 , srv1440261942:84 , srv1450787801:84 , srv1497084693:84 , srv1667187878:84 , srv1743632775:84 , srv1762251362:84 , srv1767912572:84 , srv1835475125:84 , srv1845401072:84 , srv1865630076:84 , srv1879729705:84 , srv19534600:84 , srv2001173761:84 , srv2024989742:84 , srv2102573469:84 , srv2138742991:84 , srv251466715:84 , srv331654951:84 , srv3411864:84 , srv390124255:84 , srv426102220:84 , srv442994704:84 , srv48041494:84 , srv588773107:84 , srv62969819:84 , srv694126588:84 , srv711964727:84 , srv732925134:84 , srv746336153:84 , srv759546862:84 , srv839467521:84 , srv85565136:84 , srv866401549:84 , srv949306920:84 , srv1012856079:85 , srv1046587324:85 , srv1137718279:85 , srv1158842735:85 , srv1177560631:85 , srv1205482360:85 , srv1346083401:85 , srv137567517:85 , srv1435813542:85 , srv1520264194:85 , srv1542732375:85 , srv1568317382:85 , srv1679442957:85 , srv1778603062:85 , srv1832885664:85 , srv1840157043:85 , srv1865644332:85 , srv190147403:85 , srv1934244933:85 , srv199922443:85 , srv2124200187:85 , srv2142371036:85 , srv221970897:85 , srv298493798:85 , srv302264850:85 , srv33137216:85 , srv349268522:85 , srv431730336:85 , srv479843144:85 , srv480617407:85 , srv53104733:85 , srv598249846:85 , srv627351319:85 , srv640080506:85 , srv679715972:85 , srv697111275:85 , srv730411750:85 , srv746192035:85 , srv775857279:85 , srv776412597:85 , srv806979878:85 , srv807537548:85 , srv816682416:85 , srv877462016:85 , srv892525838:85 , srv906152715:85 , srv98392959:85 , srv1345257408:86 , srv1951058558:86 , srv1982506489:638 }
2023-07-19 00:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892525838=95, srv1542732375=27, srv53104733=71, srv199922443=48, srv19534600=46, srv48041494=69, srv1143731259=7, srv1865644332=40, srv221970897=55, srv1158842735=8, srv807537548=89, srv1497084693=25, srv62969819=75, srv1435813542=21, srv1667187878=29, srv1982506489=47, srv775857279=86, srv331654951=60, srv480617407=70, srv1038246041=2, srv746192035=83, srv2024989742=50, srv426102220=65, srv2142371036=54, srv85565136=92, srv1061346337=4, srv1292599932=14, srv839467521=91, srv730411750=81, srv1205482360=11, srv137567517=19, srv190147403=42, srv1348562420=18, srv1345257408=16, srv1679442957=30, srv598249846=73, srv479843144=68, srv711964727=80, srv816682416=90, srv1376877346=20, srv1440261942=22, srv1865630076=39, srv1832885664=35, srv1470887982=24, srv2001173761=49, srv431730336=66, srv1137718279=6, srv1934244933=44, srv697111275=79, srv746336153=84, srv1743632775=31, srv1879729705=41, srv877462016=94, srv1168065335=9, srv33137216=59, srv251466715=56, srv398109448=64, srv949306920=98, srv640080506=76, srv1520264194=26, srv1450787801=23, srv1845401072=38, srv442994704=67, srv1568317382=28, srv759546862=85, srv3411864=61, srv588773107=72, srv806979878=88, srv349268522=62, srv2124200187=52, srv1951058558=45, srv1046587324=3, srv302264850=58, srv627351319=74, srv1012856079=1, srv1916306106=43, srv916054832=97, srv124120446=13, srv1012066850=0, srv2138742991=53, srv298493798=57, srv906152715=96, srv1762251362=32, srv1778603062=34, srv1108982846=5, srv694126588=78, srv390124255=63, srv98392959=99, srv1177560631=10, srv679715972=77, srv1840157043=37, srv1222477424=12, srv1835475125=36, srv2102573469=51, srv732925134=82, srv1346083401=17, srv1309676368=15, srv776412597=87, srv866401549=93, srv1767912572=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 00:53:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 00:53:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 00:53:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 00:53:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 00:53:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 00:53:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 00:53:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 00:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 00:53:14,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 00:53:14,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 00:53:14,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 00:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 00:53:15,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=9.842893039063616E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:15,032 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1168065335:83 , srv1470887982:83 , srv1916306106:83 , srv398109448:83 , srv916054832:83 , srv1012066850:84 , srv1038246041:84 , srv1061346337:84 , srv1108982846:84 , srv1143731259:84 , srv1222477424:84 , srv124120446:84 , srv1292599932:84 , srv1309676368:84 , srv1348562420:84 , srv1376877346:84 , srv1440261942:84 , srv1450787801:84 , srv1497084693:84 , srv1667187878:84 , srv1743632775:84 , srv1762251362:84 , srv1767912572:84 , srv1835475125:84 , srv1845401072:84 , srv1865630076:84 , srv1879729705:84 , srv19534600:84 , srv2001173761:84 , srv2024989742:84 , srv2102573469:84 , srv2138742991:84 , srv251466715:84 , srv331654951:84 , srv3411864:84 , srv390124255:84 , srv426102220:84 , srv442994704:84 , srv48041494:84 , srv588773107:84 , srv62969819:84 , srv694126588:84 , srv711964727:84 , srv732925134:84 , srv746336153:84 , srv759546862:84 , srv839467521:84 , srv85565136:84 , srv866401549:84 , srv949306920:84 , srv1012856079:85 , srv1046587324:85 , srv1137718279:85 , srv1158842735:85 , srv1177560631:85 , srv1205482360:85 , srv1346083401:85 , srv137567517:85 , srv1435813542:85 , srv1520264194:85 , srv1542732375:85 , srv1568317382:85 , srv1679442957:85 , srv1778603062:85 , srv1832885664:85 , srv1840157043:85 , srv1865644332:85 , srv190147403:85 , srv1934244933:85 , srv199922443:85 , srv2124200187:85 , srv2142371036:85 , srv221970897:85 , srv298493798:85 , srv302264850:85 , srv33137216:85 , srv349268522:85 , srv431730336:85 , srv479843144:85 , srv480617407:85 , srv53104733:85 , srv598249846:85 , srv627351319:85 , srv640080506:85 , srv679715972:85 , srv697111275:85 , srv730411750:85 , srv746192035:85 , srv775857279:85 , srv776412597:85 , srv806979878:85 , srv807537548:85 , srv816682416:85 , srv877462016:85 , srv892525838:85 , srv906152715:85 , srv98392959:85 , srv1345257408:86 , srv1951058558:86 , srv1982506489:638 }
2023-07-19 00:53:15,073 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=352 (was 296) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=6516 (was 7314)
2023-07-19 00:53:15,083 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=352, ProcessCount=175, AvailableMemoryMB=6517
2023-07-19 00:53:15,083 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-19 00:53:15,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-19 00:53:15,095 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv105028962:84 , srv1052406269:84 , srv1183921943:84 , srv1202439925:84 , srv1234218338:84 , srv1283647951:84 , srv1298616574:84 , srv1403114297:84 , srv1466147756:84 , srv1533666014:84 , srv1534292847:84 , srv1606591038:84 , srv1668081357:84 , srv1711225567:84 , srv1778093270:84 , srv1840690863:84 , srv187594608:84 , srv1921226791:84 , srv270592103:84 , srv285374286:84 , srv311322366:84 , srv409155034:84 , srv409260968:84 , srv594345627:84 , srv614436134:84 , srv659892605:84 , srv686096240:84 , srv962450254:84 , srv991822962:84 , srv1411802558:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-19 00:53:15,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:53:15,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1534292847=11, srv409155034=22, srv1283647951=5, srv1466147756=9, srv1403114297=7, srv594345627=24, srv270592103=19, srv1840690863=16, srv1921226791=18, srv1234218338=4, srv1411802558=8, srv1533666014=10, srv1183921943=2, srv285374286=20, srv659892605=26, srv1606591038=12, srv1202439925=3, srv105028962=0, srv991822962=29, srv1711225567=14, srv614436134=25, srv962450254=28, srv1298616574=6, srv409260968=23, srv311322366=21, srv1778093270=15, srv187594608=17, srv1052406269=1, srv1668081357=13, srv686096240=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:53:15,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:53:15,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:53:15,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:53:15,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:53:15,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:53:15,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:53:15,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:53:15,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-19 00:53:15,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0779418022854628, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:53:15,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912438635338249, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0779418022854628, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-19 00:55:15,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6100424 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912438635338249 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:55:15,125 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv105028962:90 , srv1052406269:90 , srv1183921943:90 , srv1202439925:90 , srv1234218338:90 , srv1283647951:90 , srv1298616574:90 , srv1403114297:90 , srv1411802558:90 , srv1466147756:90 , srv1533666014:90 , srv1534292847:90 , srv1606591038:90 , srv1668081357:90 , srv1711225567:90 , srv1778093270:90 , srv1840690863:90 , srv187594608:90 , srv1921226791:90 , srv270592103:90 , srv285374286:90 , srv311322366:90 , srv409155034:90 , srv409260968:90 , srv594345627:90 , srv614436134:90 , srv659892605:90 , srv686096240:90 , srv962450254:90 , srv991822962:90 }
2023-07-19 00:55:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 00:55:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1534292847=11, srv409155034=22, srv1283647951=5, srv1466147756=9, srv1403114297=7, srv594345627=24, srv270592103=19, srv1840690863=16, srv1921226791=18, srv1234218338=4, srv1411802558=8, srv1533666014=10, srv1183921943=2, srv285374286=20, srv659892605=26, srv1606591038=12, srv1202439925=3, srv105028962=0, srv991822962=29, srv1711225567=14, srv614436134=25, srv962450254=28, srv1298616574=6, srv409260968=23, srv311322366=21, srv1778093270=15, srv187594608=17, srv1052406269=1, srv1668081357=13, srv686096240=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 00:55:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 00:55:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 00:55:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 00:55:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 00:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 00:55:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 00:55:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 00:55:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 00:55:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 00:55:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 00:55:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-19 00:55:15,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 00:55:15,148 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv105028962:90 , srv1052406269:90 , srv1183921943:90 , srv1202439925:90 , srv1234218338:90 , srv1283647951:90 , srv1298616574:90 , srv1403114297:90 , srv1411802558:90 , srv1466147756:90 , srv1533666014:90 , srv1534292847:90 , srv1606591038:90 , srv1668081357:90 , srv1711225567:90 , srv1778093270:90 , srv1840690863:90 , srv187594608:90 , srv1921226791:90 , srv270592103:90 , srv285374286:90 , srv311322366:90 , srv409155034:90 , srv409260968:90 , srv594345627:90 , srv614436134:90 , srv659892605:90 , srv686096240:90 , srv962450254:90 , srv991822962:90 }
2023-07-19 00:55:15,163 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 352), ProcessCount=172 (was 175), AvailableMemoryMB=5694 (was 6517)