2023-04-24 16:55:41,011 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-24 16:55:41,397 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-24 16:55:41,523 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-24 16:55:41,594 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-24 16:55:41,603 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-24 16:55:41,621 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=367, ProcessCount=169, AvailableMemoryMB=5143
2023-04-24 16:55:41,624 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-24 16:55:41,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-24 16:55:41,782 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1029663418:84 , srv1069489103:84 , srv107299013:84 , srv1096881623:84 , srv1108097043:84 , srv1123828528:84 , srv113407493:84 , srv11415772:84 , srv1177303827:84 , srv1223679741:84 , srv1225543695:84 , srv1234871751:84 , srv1249949966:84 , srv1265151935:84 , srv1312945948:84 , srv1326459170:84 , srv1379323603:84 , srv1474218998:84 , srv1491167442:84 , srv1515056040:84 , srv1543056051:84 , srv1563992282:84 , srv1572149405:84 , srv1596277444:84 , srv1617406392:84 , srv1634358681:84 , srv1644579712:84 , srv1659408097:84 , srv1663594916:84 , srv1688325710:84 , srv174966139:84 , srv178579687:84 , srv1854619778:84 , srv1884432041:84 , srv188823660:84 , srv1922150793:84 , srv1944492520:84 , srv194919570:84 , srv1960623433:84 , srv201489379:84 , srv2025694046:84 , srv2033987228:84 , srv2037272701:84 , srv2052682096:84 , srv2057007235:84 , srv2057163288:84 , srv2137796820:84 , srv214239140:84 , srv235690843:84 , srv260803127:84 , srv26393257:84 , srv274533834:84 , srv278249052:84 , srv302507621:84 , srv316990697:84 , srv323290596:84 , srv338506478:84 , srv344343452:84 , srv361100951:84 , srv366893535:84 , srv371816429:84 , srv390399078:84 , srv404525956:84 , srv410816220:84 , srv432446732:84 , srv446530186:84 , srv501095365:84 , srv516280582:84 , srv532897383:84 , srv541274035:84 , srv563559708:84 , srv637328968:84 , srv638531320:84 , srv642882130:84 , srv649420004:84 , srv68455795:84 , srv69105593:84 , srv711176586:84 , srv716611754:84 , srv73122501:84 , srv743863220:84 , srv745372162:84 , srv752662850:84 , srv772793817:84 , srv774944796:84 , srv805158244:84 , srv809945292:84 , srv826674111:84 , srv832986549:84 , srv847289448:84 , srv863744184:84 , srv881201650:84 , srv884847109:84 , srv889693485:84 , srv905820344:84 , srv920810910:84 , srv922867121:84 , srv941368500:84 , srv975782601:84 , srv450715931:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-24 16:55:41,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:41,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137796820=46, srv274533834=51, srv235690843=48, srv1491167442=18, srv316990697=54, srv863744184=91, srv1265151935=13, srv1123828528=5, srv1922150793=35, srv563559708=71, srv1312945948=14, srv905820344=95, srv1688325710=29, srv390399078=61, srv174966139=30, srv774944796=85, srv26393257=50, srv2025694046=40, srv404525956=62, srv638531320=73, srv745372162=82, srv1108097043=4, srv826674111=88, srv772793817=84, srv201489379=39, srv178579687=31, srv743863220=81, srv73122501=80, srv809945292=87, srv1596277444=23, srv1177303827=8, srv1634358681=25, srv366893535=59, srv516280582=68, srv2057007235=44, srv410816220=63, srv1096881623=3, srv2033987228=41, srv1572149405=22, srv338506478=56, srv446530186=65, srv432446732=64, srv711176586=78, srv805158244=86, srv920810910=96, srv884847109=93, srv1944492520=36, srv1960623433=38, srv450715931=66, srv1884432041=33, srv2057163288=45, srv1069489103=1, srv1474218998=17, srv1663594916=28, srv361100951=58, srv1249949966=12, srv194919570=37, srv541274035=70, srv278249052=52, srv302507621=53, srv2052682096=43, srv371816429=60, srv889693485=94, srv1234871751=11, srv260803127=49, srv847289448=90, srv344343452=57, srv214239140=47, srv642882130=74, srv922867121=97, srv1659408097=27, srv11415772=7, srv881201650=92, srv323290596=55, srv1563992282=21, srv637328968=72, srv1854619778=32, srv716611754=79, srv69105593=77, srv1644579712=26, srv1326459170=15, srv1379323603=16, srv1543056051=20, srv1223679741=9, srv941368500=98, srv532897383=69, srv501095365=67, srv832986549=89, srv1029663418=0, srv68455795=76, srv752662850=83, srv1225543695=10, srv113407493=6, srv649420004=75, srv975782601=99, srv188823660=34, srv107299013=2, srv1515056040=19, srv2037272701=42, srv1617406392=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:41,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:41,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:41,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:41,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:41,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:41,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:41,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:41,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:41,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:41,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:41,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:41,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:41,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:41,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:41,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:41,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:41,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:41,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:41,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-24 16:55:41,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-24 16:55:41,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-24 16:55:41,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-24 16:55:41,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-24 16:55:41,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-24 16:55:41,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-24 16:55:41,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-24 16:55:41,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-24 16:55:41,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-24 16:55:41,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-24 16:55:41,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-24 16:55:41,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-24 16:55:41,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-24 16:55:41,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-24 16:55:41,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-24 16:55:41,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-24 16:55:41,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-24 16:55:41,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-24 16:55:41,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-24 16:55:41,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-24 16:55:41,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-24 16:55:41,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-24 16:55:41,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-24 16:55:41,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-24 16:55:41,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-24 16:55:41,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-24 16:55:41,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-24 16:55:42,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:42,178 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-24 16:55:42,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-24 16:55:42,607 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 619 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17654982555492882. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040523756424687814, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057252860288577234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040523756424687814, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23733333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:42,623 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1265151935:81 , srv711176586:81 , srv1069489103:82 , srv1223679741:82 , srv637328968:82 , srv73122501:82 , srv743863220:82 , srv975782601:82 , srv1234871751:83 , srv1543056051:83 , srv1663594916:83 , srv344343452:83 , srv390399078:83 , srv772793817:83 , srv881201650:83 , srv1096881623:84 , srv1123828528:84 , srv11415772:84 , srv1563992282:84 , srv1944492520:84 , srv194919570:84 , srv2057163288:84 , srv338506478:84 , srv774944796:84 , srv832986549:84 , srv1108097043:85 , srv1225543695:85 , srv1249949966:85 , srv1572149405:85 , srv1596277444:85 , srv1659408097:85 , srv2037272701:85 , srv2057007235:85 , srv361100951:85 , srv432446732:85 , srv501095365:85 , srv805158244:85 , srv826674111:85 , srv941368500:85 , srv1326459170:86 , srv1491167442:86 , srv1634358681:86 , srv178579687:86 , srv1854619778:86 , srv2033987228:86 , srv214239140:86 , srv235690843:86 , srv446530186:86 , srv638531320:86 , srv649420004:86 , srv716611754:86 , srv920810910:86 , srv107299013:87 , srv1177303827:87 , srv1515056040:87 , srv1617406392:87 , srv1922150793:87 , srv201489379:87 , srv2052682096:87 , srv260803127:87 , srv26393257:87 , srv366893535:87 , srv371816429:87 , srv404525956:87 , srv410816220:87 , srv516280582:87 , srv532897383:87 , srv752662850:87 , srv809945292:87 , srv863744184:87 , srv884847109:87 , srv905820344:87 , srv1379323603:88 , srv1474218998:88 , srv1960623433:88 , srv2025694046:88 , srv278249052:88 , srv323290596:88 , srv563559708:88 , srv69105593:88 , srv1644579712:89 , srv68455795:89 , srv889693485:89 , srv113407493:90 , srv1312945948:90 , srv1688325710:90 , srv2137796820:90 , srv274533834:90 , srv316990697:90 , srv745372162:90 , srv922867121:90 , srv1029663418:91 , srv174966139:91 , srv188823660:91 , srv302507621:91 , srv642882130:91 , srv847289448:91 , srv541274035:93 , srv1884432041:97 , srv450715931:450 }
2023-04-24 16:55:42,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:42,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137796820=46, srv274533834=51, srv235690843=48, srv1491167442=18, srv316990697=54, srv863744184=91, srv1265151935=13, srv1123828528=5, srv1922150793=35, srv563559708=71, srv1312945948=14, srv905820344=95, srv1688325710=29, srv390399078=61, srv174966139=30, srv774944796=85, srv26393257=50, srv2025694046=40, srv404525956=62, srv638531320=73, srv745372162=82, srv1108097043=4, srv826674111=88, srv772793817=84, srv201489379=39, srv178579687=31, srv743863220=81, srv73122501=80, srv809945292=87, srv1596277444=23, srv1177303827=8, srv1634358681=25, srv366893535=59, srv516280582=68, srv2057007235=44, srv410816220=63, srv1096881623=3, srv2033987228=41, srv1572149405=22, srv338506478=56, srv446530186=65, srv432446732=64, srv711176586=78, srv805158244=86, srv920810910=96, srv884847109=93, srv1944492520=36, srv1960623433=38, srv450715931=66, srv1884432041=33, srv2057163288=45, srv1069489103=1, srv1474218998=17, srv1663594916=28, srv361100951=58, srv1249949966=12, srv194919570=37, srv541274035=70, srv278249052=52, srv302507621=53, srv2052682096=43, srv371816429=60, srv889693485=94, srv1234871751=11, srv260803127=49, srv847289448=90, srv344343452=57, srv214239140=47, srv642882130=74, srv922867121=97, srv1659408097=27, srv11415772=7, srv881201650=92, srv323290596=55, srv1563992282=21, srv637328968=72, srv1854619778=32, srv716611754=79, srv69105593=77, srv1644579712=26, srv1326459170=15, srv1379323603=16, srv1543056051=20, srv1223679741=9, srv941368500=98, srv532897383=69, srv501095365=67, srv832986549=89, srv1029663418=0, srv68455795=76, srv752662850=83, srv1225543695=10, srv113407493=6, srv649420004=75, srv975782601=99, srv188823660=34, srv107299013=2, srv1515056040=19, srv2037272701=42, srv1617406392=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:42,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:42,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:42,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:42,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-24 16:55:42,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-24 16:55:42,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-24 16:55:42,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-24 16:55:42,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-24 16:55:42,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-24 16:55:42,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-24 16:55:42,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-24 16:55:42,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-24 16:55:42,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-24 16:55:42,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-24 16:55:42,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-24 16:55:42,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-24 16:55:42,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-24 16:55:42,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-24 16:55:42,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-24 16:55:42,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-24 16:55:42,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-24 16:55:42,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-24 16:55:42,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-24 16:55:42,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-24 16:55:42,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040523756424687814, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057252860288577234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040523756424687814, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23733333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:42,832 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-24 16:55:42,833 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17651695046227536, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040523756424687814, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057252860288577234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040523756424687814, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23733333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-24 16:55:43,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 552 ms to try 5000 different iterations.  Found a solution that moves 2616 regions; Going from a computed imbalance of 0.17651695046227536 to a new imbalance of 0.013774843867804653. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020925106506408196); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03201080064641763, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2906666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020925106506408196); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:43,273 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1884432041:73 , srv541274035:79 , srv188823660:80 , srv1312945948:81 , srv1688325710:81 , srv174966139:81 , srv302507621:81 , srv316990697:81 , srv642882130:81 , srv847289448:81 , srv1029663418:82 , srv113407493:82 , srv1644579712:82 , srv1474218998:83 , srv260803127:83 , srv274533834:83 , srv278249052:83 , srv446530186:83 , srv68455795:83 , srv922867121:83 , srv178579687:84 , srv1854619778:84 , srv1960623433:84 , srv2025694046:84 , srv2137796820:84 , srv323290596:84 , srv366893535:84 , srv410816220:84 , srv516280582:84 , srv563559708:84 , srv716611754:84 , srv889693485:84 , srv107299013:85 , srv1379323603:85 , srv1491167442:85 , srv1617406392:85 , srv1922150793:85 , srv2033987228:85 , srv2052682096:85 , srv371816429:85 , srv432446732:85 , srv532897383:85 , srv69105593:85 , srv745372162:85 , srv752662850:85 , srv809945292:85 , srv905820344:85 , srv941368500:85 , srv1177303827:86 , srv1225543695:86 , srv201489379:86 , srv214239140:86 , srv26393257:86 , srv361100951:86 , srv404525956:86 , srv638531320:86 , srv1123828528:87 , srv1249949966:87 , srv1326459170:87 , srv1515056040:87 , srv1596277444:87 , srv1634358681:87 , srv2037272701:87 , srv2057163288:87 , srv344343452:87 , srv649420004:87 , srv774944796:87 , srv863744184:87 , srv920810910:87 , srv1108097043:88 , srv1234871751:88 , srv1563992282:88 , srv1572149405:88 , srv1659408097:88 , srv1663594916:88 , srv194919570:88 , srv235690843:88 , srv338506478:88 , srv390399078:88 , srv637328968:88 , srv805158244:88 , srv826674111:88 , srv832986549:88 , srv884847109:88 , srv1223679741:89 , srv1944492520:89 , srv501095365:89 , srv743863220:89 , srv2057007235:90 , srv772793817:90 , srv881201650:90 , srv1069489103:91 , srv1096881623:91 , srv11415772:91 , srv1543056051:91 , srv711176586:91 , srv73122501:91 , srv975782601:92 , srv1265151935:93 , srv450715931:510 }
2023-04-24 16:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137796820=46, srv274533834=51, srv235690843=48, srv1491167442=18, srv316990697=54, srv863744184=91, srv1265151935=13, srv1123828528=5, srv1922150793=35, srv563559708=71, srv1312945948=14, srv905820344=95, srv1688325710=29, srv390399078=61, srv174966139=30, srv774944796=85, srv26393257=50, srv2025694046=40, srv404525956=62, srv638531320=73, srv745372162=82, srv1108097043=4, srv826674111=88, srv772793817=84, srv201489379=39, srv178579687=31, srv743863220=81, srv73122501=80, srv809945292=87, srv1596277444=23, srv1177303827=8, srv1634358681=25, srv366893535=59, srv516280582=68, srv2057007235=44, srv410816220=63, srv1096881623=3, srv2033987228=41, srv1572149405=22, srv338506478=56, srv446530186=65, srv432446732=64, srv711176586=78, srv805158244=86, srv920810910=96, srv884847109=93, srv1944492520=36, srv1960623433=38, srv450715931=66, srv1884432041=33, srv2057163288=45, srv1069489103=1, srv1474218998=17, srv1663594916=28, srv361100951=58, srv1249949966=12, srv194919570=37, srv541274035=70, srv278249052=52, srv302507621=53, srv2052682096=43, srv371816429=60, srv889693485=94, srv1234871751=11, srv260803127=49, srv847289448=90, srv344343452=57, srv214239140=47, srv642882130=74, srv922867121=97, srv1659408097=27, srv11415772=7, srv881201650=92, srv323290596=55, srv1563992282=21, srv637328968=72, srv1854619778=32, srv716611754=79, srv69105593=77, srv1644579712=26, srv1326459170=15, srv1379323603=16, srv1543056051=20, srv1223679741=9, srv941368500=98, srv532897383=69, srv501095365=67, srv832986549=89, srv1029663418=0, srv68455795=76, srv752662850=83, srv1225543695=10, srv113407493=6, srv649420004=75, srv975782601=99, srv188823660=34, srv107299013=2, srv1515056040=19, srv2037272701=42, srv1617406392=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:43,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:43,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:43,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:43,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-24 16:55:43,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-24 16:55:43,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-24 16:55:43,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-24 16:55:43,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-24 16:55:43,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-24 16:55:43,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-24 16:55:43,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-24 16:55:43,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-24 16:55:43,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-24 16:55:43,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-24 16:55:43,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-24 16:55:43,511 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020925106506408196); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03201080064641763, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020925106506408196); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:43,512 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-24 16:55:43,512 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013756526244294234, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020925106506408196); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03201080064641763, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020925106506408196); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-24 16:55:43,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 529 ms to try 5000 different iterations.  Found a solution that moves 967 regions; Going from a computed imbalance of 0.013756526244294234 to a new imbalance of 3.8099126687835347E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0051995951764298885); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004237611507758188); MoveCostFunction : (multiplier=7.0, imbalance=0.10744444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0051995951764298885); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:43,885 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv11415772:82 , srv745372162:82 , srv1096881623:83 , srv1177303827:83 , srv1515056040:83 , srv2057007235:83 , srv2137796820:83 , srv235690843:83 , srv501095365:83 , srv863744184:83 , srv884847109:83 , srv1069489103:84 , srv1265151935:84 , srv1379323603:84 , srv1543056051:84 , srv1572149405:84 , srv1659408097:84 , srv1944492520:84 , srv201489379:84 , srv26393257:84 , srv649420004:84 , srv73122501:84 , srv805158244:84 , srv920810910:84 , srv975782601:84 , srv1029663418:85 , srv107299013:85 , srv1108097043:85 , srv1249949966:85 , srv1326459170:85 , srv1563992282:85 , srv1596277444:85 , srv1634358681:85 , srv1922150793:85 , srv2025694046:85 , srv2037272701:85 , srv214239140:85 , srv274533834:85 , srv338506478:85 , srv404525956:85 , srv541274035:85 , srv69105593:85 , srv711176586:85 , srv752662850:85 , srv772793817:85 , srv826674111:85 , srv832986549:85 , srv847289448:85 , srv881201650:85 , srv889693485:85 , srv113407493:86 , srv1223679741:86 , srv1234871751:86 , srv1312945948:86 , srv1491167442:86 , srv1617406392:86 , srv1663594916:86 , srv174966139:86 , srv188823660:86 , srv194919570:86 , srv1960623433:86 , srv2052682096:86 , srv323290596:86 , srv361100951:86 , srv371816429:86 , srv390399078:86 , srv516280582:86 , srv532897383:86 , srv563559708:86 , srv638531320:86 , srv642882130:86 , srv68455795:86 , srv809945292:86 , srv905820344:86 , srv922867121:86 , srv1123828528:87 , srv1225543695:87 , srv1474218998:87 , srv1644579712:87 , srv1688325710:87 , srv1854619778:87 , srv1884432041:87 , srv2033987228:87 , srv2057163288:87 , srv278249052:87 , srv302507621:87 , srv316990697:87 , srv344343452:87 , srv366893535:87 , srv410816220:87 , srv637328968:87 , srv716611754:87 , srv743863220:87 , srv774944796:87 , srv178579687:88 , srv260803127:88 , srv432446732:88 , srv941368500:88 , srv446530186:89 , srv450715931:544 }
2023-04-24 16:55:43,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:43,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137796820=46, srv274533834=51, srv235690843=48, srv1491167442=18, srv316990697=54, srv863744184=91, srv1265151935=13, srv1123828528=5, srv1922150793=35, srv563559708=71, srv1312945948=14, srv905820344=95, srv1688325710=29, srv390399078=61, srv174966139=30, srv774944796=85, srv26393257=50, srv2025694046=40, srv404525956=62, srv638531320=73, srv745372162=82, srv1108097043=4, srv826674111=88, srv772793817=84, srv201489379=39, srv178579687=31, srv743863220=81, srv73122501=80, srv809945292=87, srv1596277444=23, srv1177303827=8, srv1634358681=25, srv366893535=59, srv516280582=68, srv2057007235=44, srv410816220=63, srv1096881623=3, srv2033987228=41, srv1572149405=22, srv338506478=56, srv446530186=65, srv432446732=64, srv711176586=78, srv805158244=86, srv920810910=96, srv884847109=93, srv1944492520=36, srv1960623433=38, srv450715931=66, srv1884432041=33, srv2057163288=45, srv1069489103=1, srv1474218998=17, srv1663594916=28, srv361100951=58, srv1249949966=12, srv194919570=37, srv541274035=70, srv278249052=52, srv302507621=53, srv2052682096=43, srv371816429=60, srv889693485=94, srv1234871751=11, srv260803127=49, srv847289448=90, srv344343452=57, srv214239140=47, srv642882130=74, srv922867121=97, srv1659408097=27, srv11415772=7, srv881201650=92, srv323290596=55, srv1563992282=21, srv637328968=72, srv1854619778=32, srv716611754=79, srv69105593=77, srv1644579712=26, srv1326459170=15, srv1379323603=16, srv1543056051=20, srv1223679741=9, srv941368500=98, srv532897383=69, srv501095365=67, srv832986549=89, srv1029663418=0, srv68455795=76, srv752662850=83, srv1225543695=10, srv113407493=6, srv649420004=75, srv975782601=99, srv188823660=34, srv107299013=2, srv1515056040=19, srv2037272701=42, srv1617406392=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:43,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:43,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:43,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:43,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:43,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:43,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:43,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:43,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:43,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:43,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:43,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:43,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:43,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:43,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-24 16:55:43,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-24 16:55:43,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-24 16:55:43,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-24 16:55:43,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-24 16:55:43,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-24 16:55:43,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-24 16:55:43,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-24 16:55:43,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-24 16:55:43,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-24 16:55:43,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-24 16:55:43,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-24 16:55:43,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-24 16:55:43,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-24 16:55:43,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-24 16:55:43,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-24 16:55:44,077 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0051995951764298885); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004237611507758188); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0051995951764298885); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:44,077 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-24 16:55:44,079 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.7422018815718604E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0051995951764298885); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004237611507758188); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0051995951764298885); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-24 16:55:44,549 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 611 ms to try 5000 different iterations.  Found a solution that moves 194 regions; Going from a computed imbalance of 3.7422018815718604E-4 to a new imbalance of 2.7359944893416098E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.021555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:44,550 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv302507621:83 , srv316990697:83 , srv922867121:83 , srv1029663418:84 , srv1096881623:84 , srv1108097043:84 , srv1123828528:84 , srv113407493:84 , srv1225543695:84 , srv1234871751:84 , srv1265151935:84 , srv1474218998:84 , srv1543056051:84 , srv1617406392:84 , srv1634358681:84 , srv1644579712:84 , srv1688325710:84 , srv174966139:84 , srv178579687:84 , srv1922150793:84 , srv194919570:84 , srv1960623433:84 , srv2033987228:84 , srv2052682096:84 , srv2057007235:84 , srv2057163288:84 , srv260803127:84 , srv274533834:84 , srv323290596:84 , srv366893535:84 , srv371816429:84 , srv410816220:84 , srv432446732:84 , srv446530186:84 , srv532897383:84 , srv563559708:84 , srv638531320:84 , srv642882130:84 , srv68455795:84 , srv69105593:84 , srv711176586:84 , srv743863220:84 , srv772793817:84 , srv774944796:84 , srv809945292:84 , srv826674111:84 , srv847289448:84 , srv881201650:84 , srv884847109:84 , srv889693485:84 , srv905820344:84 , srv941368500:84 , srv975782601:84 , srv1069489103:85 , srv107299013:85 , srv11415772:85 , srv1223679741:85 , srv1249949966:85 , srv1312945948:85 , srv1326459170:85 , srv1379323603:85 , srv1491167442:85 , srv1515056040:85 , srv1563992282:85 , srv1572149405:85 , srv1596277444:85 , srv1659408097:85 , srv1663594916:85 , srv1854619778:85 , srv1884432041:85 , srv188823660:85 , srv1944492520:85 , srv201489379:85 , srv2025694046:85 , srv2037272701:85 , srv2137796820:85 , srv214239140:85 , srv235690843:85 , srv26393257:85 , srv278249052:85 , srv338506478:85 , srv344343452:85 , srv361100951:85 , srv390399078:85 , srv404525956:85 , srv501095365:85 , srv516280582:85 , srv541274035:85 , srv637328968:85 , srv649420004:85 , srv716611754:85 , srv73122501:85 , srv745372162:85 , srv752662850:85 , srv805158244:85 , srv863744184:85 , srv920810910:85 , srv1177303827:86 , srv832986549:86 , srv450715931:639 }
2023-04-24 16:55:44,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:44,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137796820=46, srv274533834=51, srv235690843=48, srv1491167442=18, srv316990697=54, srv863744184=91, srv1265151935=13, srv1123828528=5, srv1922150793=35, srv563559708=71, srv1312945948=14, srv905820344=95, srv1688325710=29, srv390399078=61, srv174966139=30, srv774944796=85, srv26393257=50, srv2025694046=40, srv404525956=62, srv638531320=73, srv745372162=82, srv1108097043=4, srv826674111=88, srv772793817=84, srv201489379=39, srv178579687=31, srv743863220=81, srv73122501=80, srv809945292=87, srv1596277444=23, srv1177303827=8, srv1634358681=25, srv366893535=59, srv516280582=68, srv2057007235=44, srv410816220=63, srv1096881623=3, srv2033987228=41, srv1572149405=22, srv338506478=56, srv446530186=65, srv432446732=64, srv711176586=78, srv805158244=86, srv920810910=96, srv884847109=93, srv1944492520=36, srv1960623433=38, srv450715931=66, srv1884432041=33, srv2057163288=45, srv1069489103=1, srv1474218998=17, srv1663594916=28, srv361100951=58, srv1249949966=12, srv194919570=37, srv541274035=70, srv278249052=52, srv302507621=53, srv2052682096=43, srv371816429=60, srv889693485=94, srv1234871751=11, srv260803127=49, srv847289448=90, srv344343452=57, srv214239140=47, srv642882130=74, srv922867121=97, srv1659408097=27, srv11415772=7, srv881201650=92, srv323290596=55, srv1563992282=21, srv637328968=72, srv1854619778=32, srv716611754=79, srv69105593=77, srv1644579712=26, srv1326459170=15, srv1379323603=16, srv1543056051=20, srv1223679741=9, srv941368500=98, srv532897383=69, srv501095365=67, srv832986549=89, srv1029663418=0, srv68455795=76, srv752662850=83, srv1225543695=10, srv113407493=6, srv649420004=75, srv975782601=99, srv188823660=34, srv107299013=2, srv1515056040=19, srv2037272701=42, srv1617406392=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-24 16:55:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-24 16:55:44,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-24 16:55:44,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-24 16:55:44,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-24 16:55:44,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-24 16:55:44,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-24 16:55:44,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-24 16:55:44,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-24 16:55:44,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-24 16:55:44,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-24 16:55:44,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-24 16:55:44,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-24 16:55:44,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-24 16:55:44,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:44,739 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-24 16:55:44,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.600152785938665E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-24 16:55:45,049 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 441 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 2.600152785938665E-5 to a new imbalance of 6.615052311728012E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:45,049 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1326459170:83 , srv278249052:83 , srv404525956:83 , srv832986549:83 , srv1029663418:84 , srv1069489103:84 , srv107299013:84 , srv1096881623:84 , srv1108097043:84 , srv1123828528:84 , srv113407493:84 , srv11415772:84 , srv1177303827:84 , srv1223679741:84 , srv1225543695:84 , srv1249949966:84 , srv1265151935:84 , srv1312945948:84 , srv1379323603:84 , srv1474218998:84 , srv1491167442:84 , srv1515056040:84 , srv1543056051:84 , srv1563992282:84 , srv1572149405:84 , srv1596277444:84 , srv1617406392:84 , srv1634358681:84 , srv1644579712:84 , srv1659408097:84 , srv1663594916:84 , srv1688325710:84 , srv174966139:84 , srv178579687:84 , srv1854619778:84 , srv1884432041:84 , srv188823660:84 , srv1944492520:84 , srv194919570:84 , srv1960623433:84 , srv201489379:84 , srv2025694046:84 , srv2033987228:84 , srv2037272701:84 , srv2052682096:84 , srv2057007235:84 , srv2057163288:84 , srv2137796820:84 , srv214239140:84 , srv235690843:84 , srv260803127:84 , srv26393257:84 , srv274533834:84 , srv302507621:84 , srv323290596:84 , srv338506478:84 , srv344343452:84 , srv361100951:84 , srv366893535:84 , srv371816429:84 , srv390399078:84 , srv410816220:84 , srv432446732:84 , srv446530186:84 , srv501095365:84 , srv516280582:84 , srv532897383:84 , srv541274035:84 , srv563559708:84 , srv637328968:84 , srv638531320:84 , srv642882130:84 , srv649420004:84 , srv68455795:84 , srv69105593:84 , srv716611754:84 , srv73122501:84 , srv743863220:84 , srv745372162:84 , srv752662850:84 , srv772793817:84 , srv774944796:84 , srv805158244:84 , srv809945292:84 , srv826674111:84 , srv863744184:84 , srv881201650:84 , srv884847109:84 , srv889693485:84 , srv905820344:84 , srv920810910:84 , srv922867121:84 , srv941368500:84 , srv975782601:84 , srv1234871751:85 , srv1922150793:85 , srv316990697:85 , srv711176586:85 , srv847289448:85 , srv450715931:683 }
2023-04-24 16:55:45,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:45,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137796820=46, srv274533834=51, srv235690843=48, srv1491167442=18, srv316990697=54, srv863744184=91, srv1265151935=13, srv1123828528=5, srv1922150793=35, srv563559708=71, srv1312945948=14, srv905820344=95, srv1688325710=29, srv390399078=61, srv174966139=30, srv774944796=85, srv26393257=50, srv2025694046=40, srv404525956=62, srv638531320=73, srv745372162=82, srv1108097043=4, srv826674111=88, srv772793817=84, srv201489379=39, srv178579687=31, srv743863220=81, srv73122501=80, srv809945292=87, srv1596277444=23, srv1177303827=8, srv1634358681=25, srv366893535=59, srv516280582=68, srv2057007235=44, srv410816220=63, srv1096881623=3, srv2033987228=41, srv1572149405=22, srv338506478=56, srv446530186=65, srv432446732=64, srv711176586=78, srv805158244=86, srv920810910=96, srv884847109=93, srv1944492520=36, srv1960623433=38, srv450715931=66, srv1884432041=33, srv2057163288=45, srv1069489103=1, srv1474218998=17, srv1663594916=28, srv361100951=58, srv1249949966=12, srv194919570=37, srv541274035=70, srv278249052=52, srv302507621=53, srv2052682096=43, srv371816429=60, srv889693485=94, srv1234871751=11, srv260803127=49, srv847289448=90, srv344343452=57, srv214239140=47, srv642882130=74, srv922867121=97, srv1659408097=27, srv11415772=7, srv881201650=92, srv323290596=55, srv1563992282=21, srv637328968=72, srv1854619778=32, srv716611754=79, srv69105593=77, srv1644579712=26, srv1326459170=15, srv1379323603=16, srv1543056051=20, srv1223679741=9, srv941368500=98, srv532897383=69, srv501095365=67, srv832986549=89, srv1029663418=0, srv68455795=76, srv752662850=83, srv1225543695=10, srv113407493=6, srv649420004=75, srv975782601=99, srv188823660=34, srv107299013=2, srv1515056040=19, srv2037272701=42, srv1617406392=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:45,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-24 16:55:45,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-24 16:55:45,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-24 16:55:45,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-24 16:55:45,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-24 16:55:45,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-24 16:55:45,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-24 16:55:45,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:45,205 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1326459170:83 , srv278249052:83 , srv404525956:83 , srv832986549:83 , srv1029663418:84 , srv1069489103:84 , srv107299013:84 , srv1096881623:84 , srv1108097043:84 , srv1123828528:84 , srv113407493:84 , srv11415772:84 , srv1177303827:84 , srv1223679741:84 , srv1225543695:84 , srv1249949966:84 , srv1265151935:84 , srv1312945948:84 , srv1379323603:84 , srv1474218998:84 , srv1491167442:84 , srv1515056040:84 , srv1543056051:84 , srv1563992282:84 , srv1572149405:84 , srv1596277444:84 , srv1617406392:84 , srv1634358681:84 , srv1644579712:84 , srv1659408097:84 , srv1663594916:84 , srv1688325710:84 , srv174966139:84 , srv178579687:84 , srv1854619778:84 , srv1884432041:84 , srv188823660:84 , srv1944492520:84 , srv194919570:84 , srv1960623433:84 , srv201489379:84 , srv2025694046:84 , srv2033987228:84 , srv2037272701:84 , srv2052682096:84 , srv2057007235:84 , srv2057163288:84 , srv2137796820:84 , srv214239140:84 , srv235690843:84 , srv260803127:84 , srv26393257:84 , srv274533834:84 , srv302507621:84 , srv323290596:84 , srv338506478:84 , srv344343452:84 , srv361100951:84 , srv366893535:84 , srv371816429:84 , srv390399078:84 , srv410816220:84 , srv432446732:84 , srv446530186:84 , srv501095365:84 , srv516280582:84 , srv532897383:84 , srv541274035:84 , srv563559708:84 , srv637328968:84 , srv638531320:84 , srv642882130:84 , srv649420004:84 , srv68455795:84 , srv69105593:84 , srv716611754:84 , srv73122501:84 , srv743863220:84 , srv745372162:84 , srv752662850:84 , srv772793817:84 , srv774944796:84 , srv805158244:84 , srv809945292:84 , srv826674111:84 , srv863744184:84 , srv881201650:84 , srv884847109:84 , srv889693485:84 , srv905820344:84 , srv920810910:84 , srv922867121:84 , srv941368500:84 , srv975782601:84 , srv1234871751:85 , srv1922150793:85 , srv316990697:85 , srv711176586:85 , srv847289448:85 , srv450715931:683 }
2023-04-24 16:55:45,236 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=367 (was 367), ProcessCount=171 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=4675 (was 5143)
2023-04-24 16:55:45,253 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=367, ProcessCount=171, AvailableMemoryMB=4675
2023-04-24 16:55:45,254 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-24 16:55:45,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-24 16:55:45,270 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1093905661:84 , srv1096400645:84 , srv114212065:84 , srv1352495159:84 , srv1395791790:84 , srv1444371570:84 , srv1448755557:84 , srv153442669:84 , srv1567572809:84 , srv1607869760:84 , srv1777395020:84 , srv1848584003:84 , srv188724175:84 , srv2045367209:84 , srv2090835913:84 , srv2097367967:84 , srv2100159356:84 , srv280185585:84 , srv312333:84 , srv364994812:84 , srv365562172:84 , srv455337934:84 , srv502370517:84 , srv515892699:84 , srv573579721:84 , srv72925948:84 , srv837911608:84 , srv867288058:84 , srv984883816:84 , srv1193262016:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-24 16:55:45,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:55:45,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv280185585=18, srv312333=19, srv573579721=25, srv1777395020=11, srv1444371570=6, srv1607869760=10, srv2100159356=17, srv502370517=23, srv984883816=29, srv1096400645=1, srv365562172=21, srv1352495159=4, srv2097367967=16, srv837911608=27, srv2090835913=15, srv515892699=24, srv1395791790=5, srv72925948=26, srv1093905661=0, srv1848584003=12, srv114212065=2, srv1567572809=9, srv867288058=28, srv2045367209=14, srv1448755557=7, srv1193262016=3, srv188724175=13, srv153442669=8, srv364994812=20, srv455337934=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:55:45,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:55:45,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:55:45,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:55:45,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:55:45,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:55:45,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:55:45,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-24 16:55:45,306 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1135245105209641, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:55:45,306 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912550755290016, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1135245105209641, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-24 16:57:45,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6329996 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912550755290016 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:57:45,293 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1093905661:90 , srv1096400645:90 , srv114212065:90 , srv1193262016:90 , srv1352495159:90 , srv1395791790:90 , srv1444371570:90 , srv1448755557:90 , srv153442669:90 , srv1567572809:90 , srv1607869760:90 , srv1777395020:90 , srv1848584003:90 , srv188724175:90 , srv2045367209:90 , srv2090835913:90 , srv2097367967:90 , srv2100159356:90 , srv280185585:90 , srv312333:90 , srv364994812:90 , srv365562172:90 , srv455337934:90 , srv502370517:90 , srv515892699:90 , srv573579721:90 , srv72925948:90 , srv837911608:90 , srv867288058:90 , srv984883816:90 }
2023-04-24 16:57:45,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-24 16:57:45,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv280185585=18, srv312333=19, srv573579721=25, srv1777395020=11, srv1444371570=6, srv1607869760=10, srv2100159356=17, srv502370517=23, srv984883816=29, srv1096400645=1, srv365562172=21, srv1352495159=4, srv2097367967=16, srv837911608=27, srv2090835913=15, srv515892699=24, srv1395791790=5, srv72925948=26, srv1093905661=0, srv1848584003=12, srv114212065=2, srv1567572809=9, srv867288058=28, srv2045367209=14, srv1448755557=7, srv1193262016=3, srv188724175=13, srv153442669=8, srv364994812=20, srv455337934=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-24 16:57:45,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-24 16:57:45,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-24 16:57:45,311 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-24 16:57:45,312 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1093905661:90 , srv1096400645:90 , srv114212065:90 , srv1193262016:90 , srv1352495159:90 , srv1395791790:90 , srv1444371570:90 , srv1448755557:90 , srv153442669:90 , srv1567572809:90 , srv1607869760:90 , srv1777395020:90 , srv1848584003:90 , srv188724175:90 , srv2045367209:90 , srv2090835913:90 , srv2097367967:90 , srv2100159356:90 , srv280185585:90 , srv312333:90 , srv364994812:90 , srv365562172:90 , srv455337934:90 , srv502370517:90 , srv515892699:90 , srv573579721:90 , srv72925948:90 , srv837911608:90 , srv867288058:90 , srv984883816:90 }
2023-04-24 16:57:45,324 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 367), ProcessCount=171 (was 171), AvailableMemoryMB=4708 (was 4675) - AvailableMemoryMB LEAK? -