2023-12-19 12:53:15,020 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-19 12:53:15,359 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-19 12:53:15,474 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-19 12:53:15,543 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 12:53:15,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-19 12:53:15,563 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=168, AvailableMemoryMB=3714
2023-12-19 12:53:15,565 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 12:53:15,566 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-19 12:53:15,698 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv10347864:84 , srv1086721244:84 , srv110215610:84 , srv1112574834:84 , srv1151003416:84 , srv1164802695:84 , srv1175378204:84 , srv1177910347:84 , srv1256634982:84 , srv1276480289:84 , srv1299511311:84 , srv1309147358:84 , srv1309350127:84 , srv1320205248:84 , srv1420378461:84 , srv1448673411:84 , srv14511779:84 , srv1454016306:84 , srv1516596029:84 , srv1581159159:84 , srv1635109207:84 , srv1653694318:84 , srv1658163689:84 , srv1668736369:84 , srv1779920245:84 , srv1813969038:84 , srv1822469052:84 , srv1828359120:84 , srv1830162130:84 , srv1832978384:84 , srv183872021:84 , srv1847758593:84 , srv185118707:84 , srv1854441194:84 , srv1868020330:84 , srv187364076:84 , srv1879318805:84 , srv190071749:84 , srv1902690884:84 , srv1921681494:84 , srv1933822074:84 , srv1941371040:84 , srv195232244:84 , srv1958782412:84 , srv1958961354:84 , srv1970972045:84 , srv1995801590:84 , srv2022325616:84 , srv2033949006:84 , srv2058542032:84 , srv2062156246:84 , srv2078585854:84 , srv2080416618:84 , srv2082359365:84 , srv2098015511:84 , srv2098502283:84 , srv2109482940:84 , srv2128798298:84 , srv2130925647:84 , srv2140609738:84 , srv233477737:84 , srv253625476:84 , srv277114297:84 , srv336943682:84 , srv352767192:84 , srv388490926:84 , srv391584714:84 , srv393743721:84 , srv399383082:84 , srv406599812:84 , srv443846886:84 , srv485071529:84 , srv489075121:84 , srv507702805:84 , srv545177925:84 , srv546268455:84 , srv576420980:84 , srv580857926:84 , srv593768793:84 , srv651324254:84 , srv656132018:84 , srv658491697:84 , srv680670649:84 , srv712901747:84 , srv71657584:84 , srv761597467:84 , srv779284383:84 , srv799077755:84 , srv836636644:84 , srv848035956:84 , srv852076202:84 , srv861420137:84 , srv862570014:84 , srv919167342:84 , srv923335089:84 , srv93408886:84 , srv946086999:84 , srv975614593:84 , srv991292394:84 , srv1302217490:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-19 12:53:15,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:15,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv712901747=84, srv1854441194=34, srv848035956=90, srv2140609738=60, srv1828359120=28, srv1112574834=3, srv1902690884=39, srv485071529=72, srv1516596029=19, srv406599812=70, srv1653694318=22, srv443846886=71, srv10347864=0, srv195232244=43, srv1175378204=6, srv1847758593=32, srv277114297=63, srv1302217490=11, srv836636644=89, srv489075121=73, srv183872021=31, srv2062156246=51, srv1822469052=27, srv1868020330=35, srv393743721=68, srv2033949006=49, srv651324254=80, srv190071749=38, srv1970972045=46, srv185118707=33, srv852076202=91, srv2098015511=55, srv1086721244=1, srv1276480289=9, srv1958961354=45, srv546268455=76, srv923335089=95, srv991292394=99, srv1830162130=29, srv545177925=75, srv2130925647=59, srv658491697=82, srv1995801590=47, srv352767192=65, srv946086999=97, srv2109482940=57, srv71657584=85, srv1832978384=30, srv1177910347=7, srv2022325616=48, srv93408886=96, srv1320205248=14, srv187364076=36, srv2082359365=54, srv1635109207=21, srv1658163689=23, srv919167342=94, srv399383082=69, srv2098502283=56, srv580857926=78, srv1921681494=40, srv1420378461=15, srv1933822074=41, srv388490926=66, srv1309350127=13, srv975614593=98, srv861420137=92, srv656132018=81, srv1958782412=44, srv233477737=61, srv336943682=64, srv1299511311=10, srv1779920245=25, srv1256634982=8, srv110215610=2, srv1879318805=37, srv1668736369=24, srv391584714=67, srv1454016306=18, srv2078585854=52, srv2080416618=53, srv576420980=77, srv779284383=87, srv1448673411=16, srv862570014=93, srv1813969038=26, srv253625476=62, srv1581159159=20, srv799077755=88, srv1309147358=12, srv507702805=74, srv1151003416=4, srv593768793=79, srv761597467=86, srv14511779=17, srv2128798298=58, srv1164802695=5, srv1941371040=42, srv2058542032=50, srv680670649=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:15,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:15,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:15,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:15,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:15,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:15,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:15,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:15,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:15,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:15,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:15,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:15,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:15,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:15,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 12:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 12:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 12:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 12:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 12:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 12:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 12:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 12:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 12:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 12:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 12:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 12:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 12:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 12:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 12:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 12:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 12:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 12:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 12:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 12:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 12:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 12:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 12:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 12:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 12:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 12:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 12:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 12:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 12:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 12:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 12:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 12:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 12:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 12:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 12:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 12:53:15,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 12:53:15,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 12:53:15,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 12:53:15,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 12:53:16,221 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:16,221 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 12:53:16,222 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 12:53:16,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 777 ms to try 5000 different iterations.  Found a solution that moves 4679 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1788869825932278. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04111702569156617, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05585173574816679, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5198888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04111702569156617, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17375, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:16,649 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv233477737:81 , srv1256634982:82 , srv1448673411:82 , srv1847758593:82 , srv2022325616:82 , srv546268455:82 , srv919167342:82 , srv1086721244:83 , srv1653694318:83 , srv1970972045:83 , srv2080416618:83 , srv2098502283:83 , srv2109482940:83 , srv2128798298:83 , srv545177925:83 , srv651324254:83 , srv779284383:83 , srv799077755:83 , srv93408886:83 , srv1164802695:84 , srv1177910347:84 , srv1635109207:84 , srv1822469052:84 , srv187364076:84 , srv2062156246:84 , srv352767192:84 , srv507702805:84 , srv975614593:84 , srv1320205248:85 , srv14511779:85 , srv1454016306:85 , srv1581159159:85 , srv1828359120:85 , srv1921681494:85 , srv1958782412:85 , srv2033949006:85 , srv2140609738:85 , srv656132018:85 , srv71657584:85 , srv862570014:85 , srv946086999:85 , srv10347864:86 , srv1151003416:86 , srv1309147358:86 , srv1813969038:86 , srv1832978384:86 , srv1879318805:86 , srv1941371040:86 , srv2058542032:86 , srv388490926:86 , srv399383082:86 , srv406599812:86 , srv485071529:86 , srv576420980:86 , srv761597467:86 , srv1299511311:87 , srv1309350127:87 , srv1668736369:87 , srv1854441194:87 , srv190071749:87 , srv1933822074:87 , srv1958961354:87 , srv2082359365:87 , srv2130925647:87 , srv253625476:87 , srv336943682:87 , srv489075121:87 , srv658491697:87 , srv836636644:87 , srv848035956:87 , srv861420137:87 , srv991292394:87 , srv110215610:88 , srv1658163689:88 , srv1830162130:88 , srv1868020330:88 , srv2078585854:88 , srv391584714:88 , srv593768793:88 , srv712901747:88 , srv923335089:88 , srv1276480289:89 , srv1516596029:89 , srv277114297:89 , srv393743721:89 , srv443846886:89 , srv680670649:89 , srv1175378204:90 , srv1779920245:90 , srv185118707:90 , srv195232244:90 , srv852076202:90 , srv183872021:91 , srv580857926:91 , srv1420378461:92 , srv2098015511:92 , srv1112574834:93 , srv1995801590:93 , srv1902690884:104 , srv1302217490:455 }
2023-12-19 12:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv712901747=84, srv1854441194=34, srv848035956=90, srv2140609738=60, srv1828359120=28, srv1112574834=3, srv1902690884=39, srv485071529=72, srv1516596029=19, srv406599812=70, srv1653694318=22, srv443846886=71, srv10347864=0, srv195232244=43, srv1175378204=6, srv1847758593=32, srv277114297=63, srv1302217490=11, srv836636644=89, srv489075121=73, srv183872021=31, srv2062156246=51, srv1822469052=27, srv1868020330=35, srv393743721=68, srv2033949006=49, srv651324254=80, srv190071749=38, srv1970972045=46, srv185118707=33, srv852076202=91, srv2098015511=55, srv1086721244=1, srv1276480289=9, srv1958961354=45, srv546268455=76, srv923335089=95, srv991292394=99, srv1830162130=29, srv545177925=75, srv2130925647=59, srv658491697=82, srv1995801590=47, srv352767192=65, srv946086999=97, srv2109482940=57, srv71657584=85, srv1832978384=30, srv1177910347=7, srv2022325616=48, srv93408886=96, srv1320205248=14, srv187364076=36, srv2082359365=54, srv1635109207=21, srv1658163689=23, srv919167342=94, srv399383082=69, srv2098502283=56, srv580857926=78, srv1921681494=40, srv1420378461=15, srv1933822074=41, srv388490926=66, srv1309350127=13, srv975614593=98, srv861420137=92, srv656132018=81, srv1958782412=44, srv233477737=61, srv336943682=64, srv1299511311=10, srv1779920245=25, srv1256634982=8, srv110215610=2, srv1879318805=37, srv1668736369=24, srv391584714=67, srv1454016306=18, srv2078585854=52, srv2080416618=53, srv576420980=77, srv779284383=87, srv1448673411=16, srv862570014=93, srv1813969038=26, srv253625476=62, srv1581159159=20, srv799077755=88, srv1309147358=12, srv507702805=74, srv1151003416=4, srv593768793=79, srv761597467=86, srv14511779=17, srv2128798298=58, srv1164802695=5, srv1941371040=42, srv2058542032=50, srv680670649=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 12:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 12:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 12:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 12:53:16,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04111702569156617, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05585173574816679, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04111702569156617, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17375, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:16,802 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 12:53:16,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17885421953496888, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04111702569156617, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05585173574816679, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04111702569156617, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17375, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 12:53:17,072 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 381 ms to try 5000 different iterations.  Found a solution that moves 2651 regions; Going from a computed imbalance of 0.17885421953496888 to a new imbalance of 0.015616854154174915. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022396065248627393); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034592383506098515, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29455555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022396065248627393); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:17,082 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1902690884:70 , srv1112574834:76 , srv1995801590:80 , srv2098015511:80 , srv443846886:81 , srv1175378204:82 , srv1658163689:82 , srv1779920245:82 , srv183872021:82 , srv185118707:82 , srv253625476:82 , srv277114297:82 , srv1420378461:83 , srv1830162130:83 , srv1868020330:83 , srv2078585854:83 , srv393743721:83 , srv406599812:83 , srv593768793:83 , srv110215610:84 , srv1151003416:84 , srv1299511311:84 , srv1516596029:84 , srv1668736369:84 , srv1832978384:84 , srv1933822074:84 , srv195232244:84 , srv2082359365:84 , srv485071529:84 , srv580857926:84 , srv658491697:84 , srv852076202:84 , srv923335089:84 , srv1813969038:85 , srv1828359120:85 , srv2140609738:85 , srv336943682:85 , srv391584714:85 , srv680670649:85 , srv712901747:85 , srv761597467:85 , srv946086999:85 , srv991292394:85 , srv10347864:86 , srv1276480289:86 , srv1309147358:86 , srv1309350127:86 , srv1454016306:86 , srv1854441194:86 , srv187364076:86 , srv1879318805:86 , srv190071749:86 , srv1921681494:86 , srv1958961354:86 , srv388490926:86 , srv399383082:86 , srv576420980:86 , srv848035956:86 , srv861420137:86 , srv1086721244:87 , srv1177910347:87 , srv1581159159:87 , srv1653694318:87 , srv1941371040:87 , srv2058542032:87 , srv2128798298:87 , srv2130925647:87 , srv656132018:87 , srv836636644:87 , srv975614593:87 , srv1164802695:88 , srv1256634982:88 , srv1320205248:88 , srv1448673411:88 , srv14511779:88 , srv1822469052:88 , srv1958782412:88 , srv2033949006:88 , srv2062156246:88 , srv2109482940:88 , srv489075121:88 , srv507702805:88 , srv651324254:88 , srv779284383:88 , srv799077755:88 , srv1847758593:89 , srv1970972045:89 , srv352767192:89 , srv546268455:89 , srv919167342:89 , srv1635109207:90 , srv2080416618:90 , srv545177925:90 , srv71657584:90 , srv862570014:90 , srv2098502283:91 , srv93408886:91 , srv2022325616:92 , srv233477737:92 , srv1302217490:518 }
2023-12-19 12:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv712901747=84, srv1854441194=34, srv848035956=90, srv2140609738=60, srv1828359120=28, srv1112574834=3, srv1902690884=39, srv485071529=72, srv1516596029=19, srv406599812=70, srv1653694318=22, srv443846886=71, srv10347864=0, srv195232244=43, srv1175378204=6, srv1847758593=32, srv277114297=63, srv1302217490=11, srv836636644=89, srv489075121=73, srv183872021=31, srv2062156246=51, srv1822469052=27, srv1868020330=35, srv393743721=68, srv2033949006=49, srv651324254=80, srv190071749=38, srv1970972045=46, srv185118707=33, srv852076202=91, srv2098015511=55, srv1086721244=1, srv1276480289=9, srv1958961354=45, srv546268455=76, srv923335089=95, srv991292394=99, srv1830162130=29, srv545177925=75, srv2130925647=59, srv658491697=82, srv1995801590=47, srv352767192=65, srv946086999=97, srv2109482940=57, srv71657584=85, srv1832978384=30, srv1177910347=7, srv2022325616=48, srv93408886=96, srv1320205248=14, srv187364076=36, srv2082359365=54, srv1635109207=21, srv1658163689=23, srv919167342=94, srv399383082=69, srv2098502283=56, srv580857926=78, srv1921681494=40, srv1420378461=15, srv1933822074=41, srv388490926=66, srv1309350127=13, srv975614593=98, srv861420137=92, srv656132018=81, srv1958782412=44, srv233477737=61, srv336943682=64, srv1299511311=10, srv1779920245=25, srv1256634982=8, srv110215610=2, srv1879318805=37, srv1668736369=24, srv391584714=67, srv1454016306=18, srv2078585854=52, srv2080416618=53, srv576420980=77, srv779284383=87, srv1448673411=16, srv862570014=93, srv1813969038=26, srv253625476=62, srv1581159159=20, srv799077755=88, srv1309147358=12, srv507702805=74, srv1151003416=4, srv593768793=79, srv761597467=86, srv14511779=17, srv2128798298=58, srv1164802695=5, srv1941371040=42, srv2058542032=50, srv680670649=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:17,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 12:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 12:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 12:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 12:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 12:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 12:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 12:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 12:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 12:53:17,274 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022396065248627393); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034592383506098515, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022396065248627393); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:17,274 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 12:53:17,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0155982914554264, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022396065248627393); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034592383506098515, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022396065248627393); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 12:53:17,501 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 348 ms to try 5000 different iterations.  Found a solution that moves 1026 regions; Going from a computed imbalance of 0.0155982914554264 to a new imbalance of 9.680497467927336E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005097869931660642); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006338735955449387); MoveCostFunction : (multiplier=7.0, imbalance=0.114, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005097869931660642); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:17,503 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1420378461:82 , srv862570014:82 , srv1276480289:83 , srv1635109207:83 , srv195232244:83 , srv2098502283:83 , srv2130925647:83 , srv489075121:83 , srv580857926:83 , srv680670649:83 , srv71657584:83 , srv852076202:83 , srv1516596029:84 , srv1902690884:84 , srv2022325616:84 , srv545177925:84 , srv836636644:84 , srv848035956:84 , srv861420137:84 , srv93408886:84 , srv110215610:85 , srv1175378204:85 , srv1309147358:85 , srv1309350127:85 , srv1320205248:85 , srv14511779:85 , srv1779920245:85 , srv1822469052:85 , srv183872021:85 , srv1854441194:85 , srv1879318805:85 , srv190071749:85 , srv1941371040:85 , srv1958782412:85 , srv1958961354:85 , srv1970972045:85 , srv1995801590:85 , srv2033949006:85 , srv2058542032:85 , srv2062156246:85 , srv2080416618:85 , srv233477737:85 , srv277114297:85 , srv352767192:85 , srv388490926:85 , srv391584714:85 , srv399383082:85 , srv507702805:85 , srv593768793:85 , srv712901747:85 , srv923335089:85 , srv991292394:85 , srv1164802695:86 , srv1177910347:86 , srv1454016306:86 , srv1581159159:86 , srv1668736369:86 , srv1813969038:86 , srv1830162130:86 , srv1847758593:86 , srv185118707:86 , srv2078585854:86 , srv2082359365:86 , srv2098015511:86 , srv2109482940:86 , srv336943682:86 , srv393743721:86 , srv576420980:86 , srv656132018:86 , srv761597467:86 , srv799077755:86 , srv10347864:87 , srv1086721244:87 , srv1151003416:87 , srv1256634982:87 , srv1299511311:87 , srv1448673411:87 , srv1653694318:87 , srv1828359120:87 , srv1921681494:87 , srv1933822074:87 , srv2128798298:87 , srv443846886:87 , srv546268455:87 , srv658491697:87 , srv779284383:87 , srv919167342:87 , srv975614593:87 , srv1658163689:88 , srv1868020330:88 , srv187364076:88 , srv2140609738:88 , srv253625476:88 , srv406599812:88 , srv485071529:88 , srv651324254:88 , srv946086999:88 , srv1832978384:89 , srv1112574834:90 , srv1302217490:530 }
2023-12-19 12:53:17,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:17,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv712901747=84, srv1854441194=34, srv848035956=90, srv2140609738=60, srv1828359120=28, srv1112574834=3, srv1902690884=39, srv485071529=72, srv1516596029=19, srv406599812=70, srv1653694318=22, srv443846886=71, srv10347864=0, srv195232244=43, srv1175378204=6, srv1847758593=32, srv277114297=63, srv1302217490=11, srv836636644=89, srv489075121=73, srv183872021=31, srv2062156246=51, srv1822469052=27, srv1868020330=35, srv393743721=68, srv2033949006=49, srv651324254=80, srv190071749=38, srv1970972045=46, srv185118707=33, srv852076202=91, srv2098015511=55, srv1086721244=1, srv1276480289=9, srv1958961354=45, srv546268455=76, srv923335089=95, srv991292394=99, srv1830162130=29, srv545177925=75, srv2130925647=59, srv658491697=82, srv1995801590=47, srv352767192=65, srv946086999=97, srv2109482940=57, srv71657584=85, srv1832978384=30, srv1177910347=7, srv2022325616=48, srv93408886=96, srv1320205248=14, srv187364076=36, srv2082359365=54, srv1635109207=21, srv1658163689=23, srv919167342=94, srv399383082=69, srv2098502283=56, srv580857926=78, srv1921681494=40, srv1420378461=15, srv1933822074=41, srv388490926=66, srv1309350127=13, srv975614593=98, srv861420137=92, srv656132018=81, srv1958782412=44, srv233477737=61, srv336943682=64, srv1299511311=10, srv1779920245=25, srv1256634982=8, srv110215610=2, srv1879318805=37, srv1668736369=24, srv391584714=67, srv1454016306=18, srv2078585854=52, srv2080416618=53, srv576420980=77, srv779284383=87, srv1448673411=16, srv862570014=93, srv1813969038=26, srv253625476=62, srv1581159159=20, srv799077755=88, srv1309147358=12, srv507702805=74, srv1151003416=4, srv593768793=79, srv761597467=86, srv14511779=17, srv2128798298=58, srv1164802695=5, srv1941371040=42, srv2058542032=50, srv680670649=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:17,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:17,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:17,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 12:53:17,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 12:53:17,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 12:53:17,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 12:53:17,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 12:53:17,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 12:53:17,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 12:53:17,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 12:53:17,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 12:53:17,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 12:53:17,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 12:53:17,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 12:53:17,652 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005097869931660642); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006338735955449387); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005097869931660642); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:17,652 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 12:53:17,653 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.608655412416294E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005097869931660642); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006338735955449387); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005097869931660642); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 12:53:17,982 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 235 regions; Going from a computed imbalance of 9.608655412416294E-4 to a new imbalance of 3.5460961621580375E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.026111111111111113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:17,982 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv10347864:83 , srv1112574834:83 , srv1832978384:83 , srv1868020330:83 , srv1902690884:83 , srv651324254:83 , srv1151003416:84 , srv1164802695:84 , srv1177910347:84 , srv1299511311:84 , srv1320205248:84 , srv14511779:84 , srv1581159159:84 , srv1658163689:84 , srv183872021:84 , srv185118707:84 , srv1854441194:84 , srv187364076:84 , srv1933822074:84 , srv1941371040:84 , srv1958782412:84 , srv1958961354:84 , srv1995801590:84 , srv2022325616:84 , srv2033949006:84 , srv2058542032:84 , srv2062156246:84 , srv2080416618:84 , srv2098015511:84 , srv2140609738:84 , srv233477737:84 , srv336943682:84 , srv352767192:84 , srv391584714:84 , srv393743721:84 , srv485071529:84 , srv489075121:84 , srv576420980:84 , srv580857926:84 , srv656132018:84 , srv658491697:84 , srv712901747:84 , srv71657584:84 , srv779284383:84 , srv836636644:84 , srv919167342:84 , srv93408886:84 , srv946086999:84 , srv991292394:84 , srv1086721244:85 , srv110215610:85 , srv1175378204:85 , srv1256634982:85 , srv1276480289:85 , srv1309147358:85 , srv1309350127:85 , srv1420378461:85 , srv1448673411:85 , srv1454016306:85 , srv1516596029:85 , srv1653694318:85 , srv1668736369:85 , srv1779920245:85 , srv1813969038:85 , srv1822469052:85 , srv1828359120:85 , srv1830162130:85 , srv1847758593:85 , srv1879318805:85 , srv190071749:85 , srv1921681494:85 , srv195232244:85 , srv1970972045:85 , srv2078585854:85 , srv2082359365:85 , srv2098502283:85 , srv2109482940:85 , srv2128798298:85 , srv2130925647:85 , srv253625476:85 , srv277114297:85 , srv388490926:85 , srv399383082:85 , srv406599812:85 , srv443846886:85 , srv507702805:85 , srv545177925:85 , srv546268455:85 , srv593768793:85 , srv680670649:85 , srv761597467:85 , srv799077755:85 , srv848035956:85 , srv852076202:85 , srv861420137:85 , srv862570014:85 , srv923335089:85 , srv975614593:85 , srv1635109207:86 , srv1302217490:639 }
2023-12-19 12:53:17,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:17,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv712901747=84, srv1854441194=34, srv848035956=90, srv2140609738=60, srv1828359120=28, srv1112574834=3, srv1902690884=39, srv485071529=72, srv1516596029=19, srv406599812=70, srv1653694318=22, srv443846886=71, srv10347864=0, srv195232244=43, srv1175378204=6, srv1847758593=32, srv277114297=63, srv1302217490=11, srv836636644=89, srv489075121=73, srv183872021=31, srv2062156246=51, srv1822469052=27, srv1868020330=35, srv393743721=68, srv2033949006=49, srv651324254=80, srv190071749=38, srv1970972045=46, srv185118707=33, srv852076202=91, srv2098015511=55, srv1086721244=1, srv1276480289=9, srv1958961354=45, srv546268455=76, srv923335089=95, srv991292394=99, srv1830162130=29, srv545177925=75, srv2130925647=59, srv658491697=82, srv1995801590=47, srv352767192=65, srv946086999=97, srv2109482940=57, srv71657584=85, srv1832978384=30, srv1177910347=7, srv2022325616=48, srv93408886=96, srv1320205248=14, srv187364076=36, srv2082359365=54, srv1635109207=21, srv1658163689=23, srv919167342=94, srv399383082=69, srv2098502283=56, srv580857926=78, srv1921681494=40, srv1420378461=15, srv1933822074=41, srv388490926=66, srv1309350127=13, srv975614593=98, srv861420137=92, srv656132018=81, srv1958782412=44, srv233477737=61, srv336943682=64, srv1299511311=10, srv1779920245=25, srv1256634982=8, srv110215610=2, srv1879318805=37, srv1668736369=24, srv391584714=67, srv1454016306=18, srv2078585854=52, srv2080416618=53, srv576420980=77, srv779284383=87, srv1448673411=16, srv862570014=93, srv1813969038=26, srv253625476=62, srv1581159159=20, srv799077755=88, srv1309147358=12, srv507702805=74, srv1151003416=4, srv593768793=79, srv761597467=86, srv14511779=17, srv2128798298=58, srv1164802695=5, srv1941371040=42, srv2058542032=50, srv680670649=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:17,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 12:53:17,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 12:53:18,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 12:53:18,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 12:53:18,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 12:53:18,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 12:53:18,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 12:53:18,112 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:18,113 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 12:53:18,113 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.381545645149316E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 12:53:18,330 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 315 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 3.381545645149316E-5 to a new imbalance of 8.18275245717901E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:18,330 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1276480289:83 , srv1309350127:83 , srv1635109207:83 , srv190071749:83 , srv1921681494:83 , srv546268455:83 , srv975614593:83 , srv10347864:84 , srv1086721244:84 , srv110215610:84 , srv1112574834:84 , srv1164802695:84 , srv1175378204:84 , srv1256634982:84 , srv1299511311:84 , srv1309147358:84 , srv1320205248:84 , srv1420378461:84 , srv1448673411:84 , srv14511779:84 , srv1454016306:84 , srv1516596029:84 , srv1581159159:84 , srv1653694318:84 , srv1658163689:84 , srv1668736369:84 , srv1779920245:84 , srv1813969038:84 , srv1822469052:84 , srv1828359120:84 , srv1830162130:84 , srv1832978384:84 , srv183872021:84 , srv1847758593:84 , srv185118707:84 , srv1854441194:84 , srv1868020330:84 , srv187364076:84 , srv1879318805:84 , srv1933822074:84 , srv1941371040:84 , srv195232244:84 , srv1958782412:84 , srv1958961354:84 , srv1970972045:84 , srv1995801590:84 , srv2022325616:84 , srv2033949006:84 , srv2058542032:84 , srv2078585854:84 , srv2080416618:84 , srv2082359365:84 , srv2098015511:84 , srv2098502283:84 , srv2109482940:84 , srv2128798298:84 , srv2130925647:84 , srv2140609738:84 , srv233477737:84 , srv253625476:84 , srv336943682:84 , srv352767192:84 , srv388490926:84 , srv391584714:84 , srv393743721:84 , srv399383082:84 , srv406599812:84 , srv443846886:84 , srv485071529:84 , srv489075121:84 , srv507702805:84 , srv545177925:84 , srv576420980:84 , srv580857926:84 , srv651324254:84 , srv656132018:84 , srv658491697:84 , srv680670649:84 , srv712901747:84 , srv71657584:84 , srv761597467:84 , srv779284383:84 , srv799077755:84 , srv836636644:84 , srv848035956:84 , srv852076202:84 , srv861420137:84 , srv862570014:84 , srv919167342:84 , srv923335089:84 , srv93408886:84 , srv946086999:84 , srv1151003416:85 , srv1177910347:85 , srv1902690884:85 , srv2062156246:85 , srv277114297:85 , srv593768793:85 , srv991292394:85 , srv1302217490:684 }
2023-12-19 12:53:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:18,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv712901747=84, srv1854441194=34, srv848035956=90, srv2140609738=60, srv1828359120=28, srv1112574834=3, srv1902690884=39, srv485071529=72, srv1516596029=19, srv406599812=70, srv1653694318=22, srv443846886=71, srv10347864=0, srv195232244=43, srv1175378204=6, srv1847758593=32, srv277114297=63, srv1302217490=11, srv836636644=89, srv489075121=73, srv183872021=31, srv2062156246=51, srv1822469052=27, srv1868020330=35, srv393743721=68, srv2033949006=49, srv651324254=80, srv190071749=38, srv1970972045=46, srv185118707=33, srv852076202=91, srv2098015511=55, srv1086721244=1, srv1276480289=9, srv1958961354=45, srv546268455=76, srv923335089=95, srv991292394=99, srv1830162130=29, srv545177925=75, srv2130925647=59, srv658491697=82, srv1995801590=47, srv352767192=65, srv946086999=97, srv2109482940=57, srv71657584=85, srv1832978384=30, srv1177910347=7, srv2022325616=48, srv93408886=96, srv1320205248=14, srv187364076=36, srv2082359365=54, srv1635109207=21, srv1658163689=23, srv919167342=94, srv399383082=69, srv2098502283=56, srv580857926=78, srv1921681494=40, srv1420378461=15, srv1933822074=41, srv388490926=66, srv1309350127=13, srv975614593=98, srv861420137=92, srv656132018=81, srv1958782412=44, srv233477737=61, srv336943682=64, srv1299511311=10, srv1779920245=25, srv1256634982=8, srv110215610=2, srv1879318805=37, srv1668736369=24, srv391584714=67, srv1454016306=18, srv2078585854=52, srv2080416618=53, srv576420980=77, srv779284383=87, srv1448673411=16, srv862570014=93, srv1813969038=26, srv253625476=62, srv1581159159=20, srv799077755=88, srv1309147358=12, srv507702805=74, srv1151003416=4, srv593768793=79, srv761597467=86, srv14511779=17, srv2128798298=58, srv1164802695=5, srv1941371040=42, srv2058542032=50, srv680670649=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:18,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 12:53:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 12:53:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 12:53:18,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 12:53:18,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 12:53:18,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 12:53:18,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:18,471 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1276480289:83 , srv1309350127:83 , srv1635109207:83 , srv190071749:83 , srv1921681494:83 , srv546268455:83 , srv975614593:83 , srv10347864:84 , srv1086721244:84 , srv110215610:84 , srv1112574834:84 , srv1164802695:84 , srv1175378204:84 , srv1256634982:84 , srv1299511311:84 , srv1309147358:84 , srv1320205248:84 , srv1420378461:84 , srv1448673411:84 , srv14511779:84 , srv1454016306:84 , srv1516596029:84 , srv1581159159:84 , srv1653694318:84 , srv1658163689:84 , srv1668736369:84 , srv1779920245:84 , srv1813969038:84 , srv1822469052:84 , srv1828359120:84 , srv1830162130:84 , srv1832978384:84 , srv183872021:84 , srv1847758593:84 , srv185118707:84 , srv1854441194:84 , srv1868020330:84 , srv187364076:84 , srv1879318805:84 , srv1933822074:84 , srv1941371040:84 , srv195232244:84 , srv1958782412:84 , srv1958961354:84 , srv1970972045:84 , srv1995801590:84 , srv2022325616:84 , srv2033949006:84 , srv2058542032:84 , srv2078585854:84 , srv2080416618:84 , srv2082359365:84 , srv2098015511:84 , srv2098502283:84 , srv2109482940:84 , srv2128798298:84 , srv2130925647:84 , srv2140609738:84 , srv233477737:84 , srv253625476:84 , srv336943682:84 , srv352767192:84 , srv388490926:84 , srv391584714:84 , srv393743721:84 , srv399383082:84 , srv406599812:84 , srv443846886:84 , srv485071529:84 , srv489075121:84 , srv507702805:84 , srv545177925:84 , srv576420980:84 , srv580857926:84 , srv651324254:84 , srv656132018:84 , srv658491697:84 , srv680670649:84 , srv712901747:84 , srv71657584:84 , srv761597467:84 , srv779284383:84 , srv799077755:84 , srv836636644:84 , srv848035956:84 , srv852076202:84 , srv861420137:84 , srv862570014:84 , srv919167342:84 , srv923335089:84 , srv93408886:84 , srv946086999:84 , srv1151003416:85 , srv1177910347:85 , srv1902690884:85 , srv2062156246:85 , srv277114297:85 , srv593768793:85 , srv991292394:85 , srv1302217490:684 }
2023-12-19 12:53:18,497 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 313), ProcessCount=168 (was 168), AvailableMemoryMB=3102 (was 3714)
2023-12-19 12:53:18,505 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=168, AvailableMemoryMB=3102
2023-12-19 12:53:18,505 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 12:53:18,505 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-19 12:53:18,517 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1124329127:84 , srv1135411602:84 , srv1243612414:84 , srv1294804118:84 , srv1405393099:84 , srv1441088248:84 , srv1569588786:84 , srv1637032732:84 , srv1751576152:84 , srv1773360627:84 , srv1813801480:84 , srv1831856246:84 , srv2003034327:84 , srv218491398:84 , srv269938584:84 , srv303027630:84 , srv305742760:84 , srv325367077:84 , srv397557954:84 , srv44392281:84 , srv452447683:84 , srv455918286:84 , srv467646494:84 , srv50565577:84 , srv517212606:84 , srv555009773:84 , srv642647856:84 , srv699153687:84 , srv847016183:84 , srv1636842664:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-19 12:53:18,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:53:18,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1569588786=6, srv218491398=14, srv467646494=23, srv847016183=29, srv1135411602=1, srv2003034327=13, srv1294804118=3, srv1751576152=9, srv325367077=18, srv517212606=25, srv1773360627=10, srv1831856246=12, srv1441088248=5, srv555009773=26, srv642647856=27, srv1637032732=8, srv303027630=16, srv44392281=20, srv397557954=19, srv1636842664=7, srv1243612414=2, srv305742760=17, srv699153687=28, srv455918286=22, srv50565577=24, srv1813801480=11, srv452447683=21, srv269938584=15, srv1124329127=0, srv1405393099=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:53:18,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:53:18,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:53:18,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-19 12:53:18,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1293533814957022, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:53:18,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912600631545596, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1293533814957022, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-19 12:55:18,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6059230 different iterations.  Found a solution that moves 1862 regions; Going from a computed imbalance of 0.9912600631545596 to a new imbalance of 4.346000888939571E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6896296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:55:18,543 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1124329127:90 , srv1135411602:90 , srv1243612414:90 , srv1294804118:90 , srv1405393099:90 , srv1441088248:90 , srv1569588786:90 , srv1636842664:90 , srv1637032732:90 , srv1751576152:90 , srv1773360627:90 , srv1813801480:90 , srv1831856246:90 , srv2003034327:90 , srv218491398:90 , srv269938584:90 , srv303027630:90 , srv305742760:90 , srv325367077:90 , srv397557954:90 , srv44392281:90 , srv452447683:90 , srv455918286:90 , srv467646494:90 , srv50565577:90 , srv517212606:90 , srv555009773:90 , srv642647856:90 , srv699153687:90 , srv847016183:90 }
2023-12-19 12:55:18,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 12:55:18,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1569588786=6, srv218491398=14, srv467646494=23, srv847016183=29, srv1135411602=1, srv2003034327=13, srv1294804118=3, srv1751576152=9, srv325367077=18, srv517212606=25, srv1773360627=10, srv1831856246=12, srv1441088248=5, srv555009773=26, srv642647856=27, srv1637032732=8, srv303027630=16, srv44392281=20, srv397557954=19, srv1636842664=7, srv1243612414=2, srv305742760=17, srv699153687=28, srv455918286=22, srv50565577=24, srv1813801480=11, srv452447683=21, srv269938584=15, srv1124329127=0, srv1405393099=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 12:55:18,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 12:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-19 12:55:18,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 12:55:18,563 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1124329127:90 , srv1135411602:90 , srv1243612414:90 , srv1294804118:90 , srv1405393099:90 , srv1441088248:90 , srv1569588786:90 , srv1636842664:90 , srv1637032732:90 , srv1751576152:90 , srv1773360627:90 , srv1813801480:90 , srv1831856246:90 , srv2003034327:90 , srv218491398:90 , srv269938584:90 , srv303027630:90 , srv305742760:90 , srv325367077:90 , srv397557954:90 , srv44392281:90 , srv452447683:90 , srv455918286:90 , srv467646494:90 , srv50565577:90 , srv517212606:90 , srv555009773:90 , srv642647856:90 , srv699153687:90 , srv847016183:90 }
2023-12-19 12:55:18,576 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 313), ProcessCount=167 (was 168), AvailableMemoryMB=2157 (was 3102)