2023-10-08 23:53:27,149 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-08 23:53:27,447 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-08 23:53:27,566 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-08 23:53:27,633 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-08 23:53:27,640 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-08 23:53:27,653 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=169, AvailableMemoryMB=8683
2023-10-08 23:53:27,655 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-08 23:53:27,656 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-08 23:53:27,795 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv101628196:84 , srv1028479771:84 , srv1046515551:84 , srv1068338829:84 , srv1070047346:84 , srv1077592461:84 , srv1086033965:84 , srv1102819869:84 , srv110685734:84 , srv1202085117:84 , srv1202318923:84 , srv1229516360:84 , srv1230511196:84 , srv1254154935:84 , srv1257476157:84 , srv1262045917:84 , srv1279913373:84 , srv1345689554:84 , srv1381487427:84 , srv1399642723:84 , srv1406938022:84 , srv1409648557:84 , srv1420916089:84 , srv1423107319:84 , srv1423334229:84 , srv1440583003:84 , srv1453554480:84 , srv1474530369:84 , srv1493638238:84 , srv1549612517:84 , srv160153811:84 , srv1606105431:84 , srv1622047851:84 , srv1659761932:84 , srv1663978293:84 , srv1684730358:84 , srv1703483953:84 , srv1720378068:84 , srv1741059650:84 , srv1832107263:84 , srv1844283561:84 , srv187520020:84 , srv1887150875:84 , srv1913596075:84 , srv1931078015:84 , srv1961175174:84 , srv1962355654:84 , srv198739656:84 , srv2002643507:84 , srv2016668291:84 , srv2034343313:84 , srv2036103256:84 , srv209643334:84 , srv2133484236:84 , srv227372448:84 , srv265197877:84 , srv290054410:84 , srv355123265:84 , srv371792202:84 , srv381149044:84 , srv388707269:84 , srv394100765:84 , srv405793279:84 , srv41865380:84 , srv421886858:84 , srv427809852:84 , srv434874634:84 , srv437530081:84 , srv473538399:84 , srv490480079:84 , srv497802399:84 , srv535005000:84 , srv53513901:84 , srv553640826:84 , srv603301655:84 , srv603561885:84 , srv608862998:84 , srv626716258:84 , srv640972460:84 , srv67019657:84 , srv675080681:84 , srv692215694:84 , srv694606959:84 , srv766955776:84 , srv800327262:84 , srv831549665:84 , srv837033283:84 , srv848827000:84 , srv848947116:84 , srv87007628:84 , srv875574280:84 , srv888017213:84 , srv909650890:84 , srv909995221:84 , srv914463049:84 , srv935844809:84 , srv941009413:84 , srv986853121:84 , srv991616696:84 , srv169268386:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-08 23:53:27,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:27,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290054410=57, srv875574280=91, srv675080681=81, srv1703483953=37, srv388707269=61, srv640972460=79, srv535005000=72, srv110685734=8, srv101628196=0, srv473538399=69, srv434874634=67, srv888017213=92, srv437530081=68, srv986853121=98, srv1086033965=6, srv2036103256=52, srv53513901=73, srv1068338829=3, srv421886858=65, srv1409648557=21, srv371792202=59, srv227372448=55, srv837033283=87, srv87007628=90, srv1931078015=45, srv2002643507=49, srv1659761932=33, srv1720378068=38, srv935844809=96, srv914463049=95, srv1962355654=47, srv1254154935=13, srv2034343313=51, srv1345689554=17, srv2016668291=50, srv160153811=30, srv67019657=80, srv1070047346=4, srv1102819869=7, srv355123265=58, srv800327262=85, srv1622047851=32, srv1832107263=40, srv941009413=97, srv848947116=89, srv1493638238=28, srv831549665=86, srv766955776=84, srv553640826=74, srv1229516360=11, srv1406938022=20, srv1961175174=46, srv603301655=75, srv1279913373=16, srv1549612517=29, srv198739656=48, srv909995221=94, srv209643334=53, srv692215694=82, srv909650890=93, srv405793279=63, srv1423334229=24, srv497802399=71, srv1077592461=5, srv265197877=56, srv41865380=64, srv1257476157=14, srv1381487427=18, srv1844283561=41, srv1663978293=34, srv187520020=42, srv1202085117=9, srv427809852=66, srv991616696=99, srv626716258=78, srv1606105431=31, srv1684730358=35, srv1230511196=12, srv1262045917=15, srv490480079=70, srv848827000=88, srv1440583003=25, srv381149044=60, srv1474530369=27, srv2133484236=54, srv1453554480=26, srv169268386=36, srv603561885=76, srv694606959=83, srv1420916089=22, srv1887150875=43, srv1202318923=10, srv608862998=77, srv1028479771=1, srv1399642723=19, srv1913596075=44, srv1423107319=23, srv1741059650=39, srv394100765=62, srv1046515551=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:27,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:27,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:27,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-08 23:53:27,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-08 23:53:27,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-08 23:53:27,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-08 23:53:27,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-08 23:53:27,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-08 23:53:27,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-08 23:53:27,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-08 23:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-08 23:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-08 23:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-08 23:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-08 23:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-08 23:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-08 23:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-08 23:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-08 23:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-08 23:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-08 23:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-08 23:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-08 23:53:27,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-08 23:53:27,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-08 23:53:27,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-08 23:53:27,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-08 23:53:28,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:28,064 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-08 23:53:28,065 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-08 23:53:28,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 958 ms to try 5000 different iterations.  Found a solution that moves 4715 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17830240561189448. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040869401983099365, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0578612450717837, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5238888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040869401983099365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17325, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24258333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:28,910 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1028479771:82 , srv1663978293:82 , srv1720378068:82 , srv2034343313:82 , srv388707269:82 , srv490480079:82 , srv603301655:82 , srv875574280:82 , srv1068338829:83 , srv227372448:83 , srv355123265:83 , srv421886858:83 , srv434874634:83 , srv437530081:83 , srv553640826:83 , srv608862998:83 , srv640972460:83 , srv675080681:83 , srv694606959:83 , srv941009413:83 , srv1046515551:84 , srv1070047346:84 , srv1262045917:84 , srv1440583003:84 , srv1606105431:84 , srv1622047851:84 , srv1887150875:84 , srv2002643507:84 , srv405793279:84 , srv837033283:84 , srv909995221:84 , srv986853121:84 , srv1086033965:85 , srv1741059650:85 , srv1961175174:85 , srv2016668291:85 , srv209643334:85 , srv290054410:85 , srv394100765:85 , srv692215694:85 , srv1102819869:86 , srv1202318923:86 , srv1230511196:86 , srv1279913373:86 , srv1420916089:86 , srv1423107319:86 , srv1832107263:86 , srv187520020:86 , srv41865380:86 , srv427809852:86 , srv603561885:86 , srv626716258:86 , srv766955776:86 , srv888017213:86 , srv110685734:87 , srv1202085117:87 , srv1229516360:87 , srv1406938022:87 , srv1409648557:87 , srv1684730358:87 , srv1931078015:87 , srv198739656:87 , srv2036103256:87 , srv2133484236:87 , srv265197877:87 , srv497802399:87 , srv535005000:87 , srv831549665:87 , srv1077592461:88 , srv1254154935:88 , srv1381487427:88 , srv1423334229:88 , srv1493638238:88 , srv1913596075:88 , srv87007628:88 , srv914463049:88 , srv935844809:88 , srv1257476157:89 , srv1399642723:89 , srv1453554480:89 , srv160153811:89 , srv67019657:89 , srv909650890:89 , srv101628196:90 , srv1659761932:90 , srv1703483953:90 , srv371792202:90 , srv800327262:90 , srv848827000:90 , srv1345689554:91 , srv1474530369:91 , srv1549612517:91 , srv1962355654:91 , srv381149044:91 , srv53513901:91 , srv1844283561:93 , srv473538399:93 , srv848947116:93 , srv991616696:94 , srv169268386:453 }
2023-10-08 23:53:28,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:28,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290054410=57, srv875574280=91, srv675080681=81, srv1703483953=37, srv388707269=61, srv640972460=79, srv535005000=72, srv110685734=8, srv101628196=0, srv473538399=69, srv434874634=67, srv888017213=92, srv437530081=68, srv986853121=98, srv1086033965=6, srv2036103256=52, srv53513901=73, srv1068338829=3, srv421886858=65, srv1409648557=21, srv371792202=59, srv227372448=55, srv837033283=87, srv87007628=90, srv1931078015=45, srv2002643507=49, srv1659761932=33, srv1720378068=38, srv935844809=96, srv914463049=95, srv1962355654=47, srv1254154935=13, srv2034343313=51, srv1345689554=17, srv2016668291=50, srv160153811=30, srv67019657=80, srv1070047346=4, srv1102819869=7, srv355123265=58, srv800327262=85, srv1622047851=32, srv1832107263=40, srv941009413=97, srv848947116=89, srv1493638238=28, srv831549665=86, srv766955776=84, srv553640826=74, srv1229516360=11, srv1406938022=20, srv1961175174=46, srv603301655=75, srv1279913373=16, srv1549612517=29, srv198739656=48, srv909995221=94, srv209643334=53, srv692215694=82, srv909650890=93, srv405793279=63, srv1423334229=24, srv497802399=71, srv1077592461=5, srv265197877=56, srv41865380=64, srv1257476157=14, srv1381487427=18, srv1844283561=41, srv1663978293=34, srv187520020=42, srv1202085117=9, srv427809852=66, srv991616696=99, srv626716258=78, srv1606105431=31, srv1684730358=35, srv1230511196=12, srv1262045917=15, srv490480079=70, srv848827000=88, srv1440583003=25, srv381149044=60, srv1474530369=27, srv2133484236=54, srv1453554480=26, srv169268386=36, srv603561885=76, srv694606959=83, srv1420916089=22, srv1887150875=43, srv1202318923=10, srv608862998=77, srv1028479771=1, srv1399642723=19, srv1913596075=44, srv1423107319=23, srv1741059650=39, srv394100765=62, srv1046515551=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:28,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-08 23:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-08 23:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-08 23:53:28,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-08 23:53:28,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-08 23:53:28,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-08 23:53:28,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-08 23:53:28,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-08 23:53:28,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-08 23:53:28,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-08 23:53:28,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-08 23:53:29,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040869401983099365, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0578612450717837, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040869401983099365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17325, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24258333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:29,064 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-08 23:53:29,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17826939047624785, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040869401983099365, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0578612450717837, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040869401983099365, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17325, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24258333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-08 23:53:29,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 481 ms to try 5000 different iterations.  Found a solution that moves 2629 regions; Going from a computed imbalance of 0.17826939047624785 to a new imbalance of 0.013295927129671889. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021595540685023114); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03487994480993173, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2921111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021595540685023114); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:29,453 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1844283561:77 , srv991616696:78 , srv1474530369:79 , srv848947116:79 , srv1549612517:80 , srv381149044:80 , srv473538399:80 , srv101628196:81 , srv1345689554:81 , srv1962355654:81 , srv371792202:81 , srv1229516360:82 , srv1453554480:82 , srv1703483953:82 , srv53513901:82 , srv67019657:82 , srv800327262:82 , srv1399642723:83 , srv1493638238:83 , srv848827000:83 , srv87007628:83 , srv909650890:83 , srv914463049:83 , srv1077592461:84 , srv110685734:84 , srv1202318923:84 , srv1254154935:84 , srv1279913373:84 , srv1381487427:84 , srv160153811:84 , srv1659761932:84 , srv1931078015:84 , srv2036103256:84 , srv265197877:84 , srv497802399:84 , srv1086033965:85 , srv1202085117:85 , srv1257476157:85 , srv1409648557:85 , srv1423334229:85 , srv198739656:85 , srv2133484236:85 , srv394100765:85 , srv41865380:85 , srv603561885:85 , srv935844809:85 , srv1046515551:86 , srv1230511196:86 , srv1420916089:86 , srv1423107319:86 , srv1684730358:86 , srv692215694:86 , srv766955776:86 , srv831549665:86 , srv1440583003:87 , srv1606105431:87 , srv1741059650:87 , srv187520020:87 , srv1913596075:87 , srv2016668291:87 , srv209643334:87 , srv227372448:87 , srv421886858:87 , srv427809852:87 , srv535005000:87 , srv888017213:87 , srv1068338829:88 , srv1406938022:88 , srv1832107263:88 , srv1961175174:88 , srv2002643507:88 , srv2034343313:88 , srv290054410:88 , srv405793279:88 , srv626716258:88 , srv837033283:88 , srv909995221:88 , srv1070047346:89 , srv1102819869:89 , srv1262045917:89 , srv1622047851:89 , srv1720378068:89 , srv1887150875:89 , srv437530081:89 , srv553640826:89 , srv640972460:89 , srv694606959:89 , srv388707269:90 , srv434874634:90 , srv603301655:90 , srv608862998:90 , srv675080681:90 , srv941009413:90 , srv1028479771:91 , srv1663978293:91 , srv355123265:91 , srv490480079:91 , srv875574280:91 , srv986853121:92 , srv169268386:513 }
2023-10-08 23:53:29,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:29,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290054410=57, srv875574280=91, srv675080681=81, srv1703483953=37, srv388707269=61, srv640972460=79, srv535005000=72, srv110685734=8, srv101628196=0, srv473538399=69, srv434874634=67, srv888017213=92, srv437530081=68, srv986853121=98, srv1086033965=6, srv2036103256=52, srv53513901=73, srv1068338829=3, srv421886858=65, srv1409648557=21, srv371792202=59, srv227372448=55, srv837033283=87, srv87007628=90, srv1931078015=45, srv2002643507=49, srv1659761932=33, srv1720378068=38, srv935844809=96, srv914463049=95, srv1962355654=47, srv1254154935=13, srv2034343313=51, srv1345689554=17, srv2016668291=50, srv160153811=30, srv67019657=80, srv1070047346=4, srv1102819869=7, srv355123265=58, srv800327262=85, srv1622047851=32, srv1832107263=40, srv941009413=97, srv848947116=89, srv1493638238=28, srv831549665=86, srv766955776=84, srv553640826=74, srv1229516360=11, srv1406938022=20, srv1961175174=46, srv603301655=75, srv1279913373=16, srv1549612517=29, srv198739656=48, srv909995221=94, srv209643334=53, srv692215694=82, srv909650890=93, srv405793279=63, srv1423334229=24, srv497802399=71, srv1077592461=5, srv265197877=56, srv41865380=64, srv1257476157=14, srv1381487427=18, srv1844283561=41, srv1663978293=34, srv187520020=42, srv1202085117=9, srv427809852=66, srv991616696=99, srv626716258=78, srv1606105431=31, srv1684730358=35, srv1230511196=12, srv1262045917=15, srv490480079=70, srv848827000=88, srv1440583003=25, srv381149044=60, srv1474530369=27, srv2133484236=54, srv1453554480=26, srv169268386=36, srv603561885=76, srv694606959=83, srv1420916089=22, srv1887150875=43, srv1202318923=10, srv608862998=77, srv1028479771=1, srv1399642723=19, srv1913596075=44, srv1423107319=23, srv1741059650=39, srv394100765=62, srv1046515551=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:29,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:29,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:29,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:29,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-08 23:53:29,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-08 23:53:29,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-08 23:53:29,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-08 23:53:29,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-08 23:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-08 23:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-08 23:53:29,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-08 23:53:29,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-08 23:53:29,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-08 23:53:29,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-08 23:53:29,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021595540685023114); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03487994480993173, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021595540685023114); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:29,672 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-08 23:53:29,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01327751847821589, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021595540685023114); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03487994480993173, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021595540685023114); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-08 23:53:29,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 397 ms to try 5000 different iterations.  Found a solution that moves 950 regions; Going from a computed imbalance of 0.01327751847821589 to a new imbalance of 8.503428328051268E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01173022609606784); MoveCostFunction : (multiplier=7.0, imbalance=0.10555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:29,941 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1257476157:82 , srv1913596075:82 , srv986853121:82 , srv1102819869:83 , srv1406938022:83 , srv1961175174:83 , srv535005000:83 , srv935844809:83 , srv1028479771:84 , srv1070047346:84 , srv1423334229:84 , srv1622047851:84 , srv1659761932:84 , srv1663978293:84 , srv1832107263:84 , srv209643334:84 , srv355123265:84 , srv427809852:84 , srv473538399:84 , srv490480079:84 , srv608862998:84 , srv626716258:84 , srv766955776:84 , srv848827000:84 , srv888017213:84 , srv1202085117:85 , srv1230511196:85 , srv1254154935:85 , srv1262045917:85 , srv1345689554:85 , srv1381487427:85 , srv1420916089:85 , srv1453554480:85 , srv160153811:85 , srv1684730358:85 , srv187520020:85 , srv1887150875:85 , srv2016668291:85 , srv2133484236:85 , srv265197877:85 , srv290054410:85 , srv388707269:85 , srv405793279:85 , srv434874634:85 , srv53513901:85 , srv553640826:85 , srv675080681:85 , srv831549665:85 , srv837033283:85 , srv848947116:85 , srv875574280:85 , srv909650890:85 , srv909995221:85 , srv941009413:85 , srv101628196:86 , srv1077592461:86 , srv110685734:86 , srv1399642723:86 , srv1409648557:86 , srv1440583003:86 , srv1493638238:86 , srv1703483953:86 , srv1741059650:86 , srv1931078015:86 , srv1962355654:86 , srv198739656:86 , srv2002643507:86 , srv394100765:86 , srv41865380:86 , srv437530081:86 , srv497802399:86 , srv603301655:86 , srv640972460:86 , srv692215694:86 , srv694606959:86 , srv800327262:86 , srv87007628:86 , srv914463049:86 , srv991616696:86 , srv1068338829:87 , srv1086033965:87 , srv1202318923:87 , srv1279913373:87 , srv1423107319:87 , srv1474530369:87 , srv1549612517:87 , srv1606105431:87 , srv1720378068:87 , srv1844283561:87 , srv2034343313:87 , srv2036103256:87 , srv371792202:87 , srv381149044:87 , srv421886858:87 , srv603561885:87 , srv67019657:87 , srv1046515551:88 , srv1229516360:88 , srv227372448:88 , srv169268386:553 }
2023-10-08 23:53:29,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:29,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290054410=57, srv875574280=91, srv675080681=81, srv1703483953=37, srv388707269=61, srv640972460=79, srv535005000=72, srv110685734=8, srv101628196=0, srv473538399=69, srv434874634=67, srv888017213=92, srv437530081=68, srv986853121=98, srv1086033965=6, srv2036103256=52, srv53513901=73, srv1068338829=3, srv421886858=65, srv1409648557=21, srv371792202=59, srv227372448=55, srv837033283=87, srv87007628=90, srv1931078015=45, srv2002643507=49, srv1659761932=33, srv1720378068=38, srv935844809=96, srv914463049=95, srv1962355654=47, srv1254154935=13, srv2034343313=51, srv1345689554=17, srv2016668291=50, srv160153811=30, srv67019657=80, srv1070047346=4, srv1102819869=7, srv355123265=58, srv800327262=85, srv1622047851=32, srv1832107263=40, srv941009413=97, srv848947116=89, srv1493638238=28, srv831549665=86, srv766955776=84, srv553640826=74, srv1229516360=11, srv1406938022=20, srv1961175174=46, srv603301655=75, srv1279913373=16, srv1549612517=29, srv198739656=48, srv909995221=94, srv209643334=53, srv692215694=82, srv909650890=93, srv405793279=63, srv1423334229=24, srv497802399=71, srv1077592461=5, srv265197877=56, srv41865380=64, srv1257476157=14, srv1381487427=18, srv1844283561=41, srv1663978293=34, srv187520020=42, srv1202085117=9, srv427809852=66, srv991616696=99, srv626716258=78, srv1606105431=31, srv1684730358=35, srv1230511196=12, srv1262045917=15, srv490480079=70, srv848827000=88, srv1440583003=25, srv381149044=60, srv1474530369=27, srv2133484236=54, srv1453554480=26, srv169268386=36, srv603561885=76, srv694606959=83, srv1420916089=22, srv1887150875=43, srv1202318923=10, srv608862998=77, srv1028479771=1, srv1399642723=19, srv1913596075=44, srv1423107319=23, srv1741059650=39, srv394100765=62, srv1046515551=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:29,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:29,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:29,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:29,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-08 23:53:29,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-08 23:53:29,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-08 23:53:29,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-08 23:53:29,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-08 23:53:29,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-08 23:53:29,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-08 23:53:29,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-08 23:53:29,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-08 23:53:30,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01173022609606784); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:30,107 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-08 23:53:30,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.436907906281783E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01173022609606784); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-08 23:53:30,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 523 ms to try 5000 different iterations.  Found a solution that moves 296 regions; Going from a computed imbalance of 8.436907906281783E-4 to a new imbalance of 2.8655248599170827E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.03288888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:30,510 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1423107319:83 , srv198739656:83 , srv694606959:83 , srv101628196:84 , srv1046515551:84 , srv1068338829:84 , srv1077592461:84 , srv1102819869:84 , srv1262045917:84 , srv1279913373:84 , srv1399642723:84 , srv1406938022:84 , srv1409648557:84 , srv1423334229:84 , srv1474530369:84 , srv1549612517:84 , srv160153811:84 , srv1606105431:84 , srv1659761932:84 , srv1684730358:84 , srv1720378068:84 , srv1741059650:84 , srv1832107263:84 , srv187520020:84 , srv1887150875:84 , srv1962355654:84 , srv2002643507:84 , srv2036103256:84 , srv227372448:84 , srv290054410:84 , srv371792202:84 , srv381149044:84 , srv437530081:84 , srv53513901:84 , srv603301655:84 , srv603561885:84 , srv640972460:84 , srv67019657:84 , srv800327262:84 , srv831549665:84 , srv848827000:84 , srv875574280:84 , srv941009413:84 , srv986853121:84 , srv991616696:84 , srv1028479771:85 , srv1070047346:85 , srv1086033965:85 , srv110685734:85 , srv1202085117:85 , srv1202318923:85 , srv1229516360:85 , srv1230511196:85 , srv1254154935:85 , srv1257476157:85 , srv1345689554:85 , srv1420916089:85 , srv1440583003:85 , srv1493638238:85 , srv1622047851:85 , srv1663978293:85 , srv1703483953:85 , srv1913596075:85 , srv1931078015:85 , srv2016668291:85 , srv2034343313:85 , srv2133484236:85 , srv265197877:85 , srv355123265:85 , srv388707269:85 , srv405793279:85 , srv41865380:85 , srv421886858:85 , srv427809852:85 , srv434874634:85 , srv490480079:85 , srv497802399:85 , srv535005000:85 , srv608862998:85 , srv626716258:85 , srv675080681:85 , srv692215694:85 , srv837033283:85 , srv848947116:85 , srv87007628:85 , srv888017213:85 , srv909650890:85 , srv909995221:85 , srv914463049:85 , srv1381487427:86 , srv1453554480:86 , srv1844283561:86 , srv1961175174:86 , srv209643334:86 , srv394100765:86 , srv473538399:86 , srv553640826:86 , srv766955776:86 , srv935844809:86 , srv169268386:623 }
2023-10-08 23:53:30,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:30,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290054410=57, srv875574280=91, srv675080681=81, srv1703483953=37, srv388707269=61, srv640972460=79, srv535005000=72, srv110685734=8, srv101628196=0, srv473538399=69, srv434874634=67, srv888017213=92, srv437530081=68, srv986853121=98, srv1086033965=6, srv2036103256=52, srv53513901=73, srv1068338829=3, srv421886858=65, srv1409648557=21, srv371792202=59, srv227372448=55, srv837033283=87, srv87007628=90, srv1931078015=45, srv2002643507=49, srv1659761932=33, srv1720378068=38, srv935844809=96, srv914463049=95, srv1962355654=47, srv1254154935=13, srv2034343313=51, srv1345689554=17, srv2016668291=50, srv160153811=30, srv67019657=80, srv1070047346=4, srv1102819869=7, srv355123265=58, srv800327262=85, srv1622047851=32, srv1832107263=40, srv941009413=97, srv848947116=89, srv1493638238=28, srv831549665=86, srv766955776=84, srv553640826=74, srv1229516360=11, srv1406938022=20, srv1961175174=46, srv603301655=75, srv1279913373=16, srv1549612517=29, srv198739656=48, srv909995221=94, srv209643334=53, srv692215694=82, srv909650890=93, srv405793279=63, srv1423334229=24, srv497802399=71, srv1077592461=5, srv265197877=56, srv41865380=64, srv1257476157=14, srv1381487427=18, srv1844283561=41, srv1663978293=34, srv187520020=42, srv1202085117=9, srv427809852=66, srv991616696=99, srv626716258=78, srv1606105431=31, srv1684730358=35, srv1230511196=12, srv1262045917=15, srv490480079=70, srv848827000=88, srv1440583003=25, srv381149044=60, srv1474530369=27, srv2133484236=54, srv1453554480=26, srv169268386=36, srv603561885=76, srv694606959=83, srv1420916089=22, srv1887150875=43, srv1202318923=10, srv608862998=77, srv1028479771=1, srv1399642723=19, srv1913596075=44, srv1423107319=23, srv1741059650=39, srv394100765=62, srv1046515551=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:30,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:30,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-08 23:53:30,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-08 23:53:30,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-08 23:53:30,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-08 23:53:30,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-08 23:53:30,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-08 23:53:30,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-08 23:53:30,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-08 23:53:30,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-08 23:53:30,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-08 23:53:30,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-08 23:53:30,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-08 23:53:30,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-08 23:53:30,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-08 23:53:30,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:30,662 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-08 23:53:30,663 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6582612299826927E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-08 23:53:30,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 397 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 2.6582612299826927E-5 to a new imbalance of 7.262297337147979E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:30,943 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1381487427:83 , srv1703483953:83 , srv1844283561:83 , srv355123265:83 , srv434874634:83 , srv473538399:83 , srv553640826:83 , srv626716258:83 , srv675080681:83 , srv1028479771:84 , srv1046515551:84 , srv1068338829:84 , srv1070047346:84 , srv1077592461:84 , srv1086033965:84 , srv1102819869:84 , srv110685734:84 , srv1202085117:84 , srv1202318923:84 , srv1229516360:84 , srv1230511196:84 , srv1254154935:84 , srv1262045917:84 , srv1345689554:84 , srv1399642723:84 , srv1406938022:84 , srv1409648557:84 , srv1420916089:84 , srv1423107319:84 , srv1440583003:84 , srv1453554480:84 , srv1493638238:84 , srv1549612517:84 , srv160153811:84 , srv1606105431:84 , srv1622047851:84 , srv1659761932:84 , srv1663978293:84 , srv1684730358:84 , srv1720378068:84 , srv1741059650:84 , srv1832107263:84 , srv187520020:84 , srv1887150875:84 , srv1913596075:84 , srv1931078015:84 , srv1961175174:84 , srv1962355654:84 , srv2002643507:84 , srv2016668291:84 , srv2034343313:84 , srv2036103256:84 , srv209643334:84 , srv2133484236:84 , srv227372448:84 , srv290054410:84 , srv371792202:84 , srv381149044:84 , srv388707269:84 , srv394100765:84 , srv405793279:84 , srv41865380:84 , srv421886858:84 , srv427809852:84 , srv437530081:84 , srv490480079:84 , srv497802399:84 , srv535005000:84 , srv53513901:84 , srv603301655:84 , srv603561885:84 , srv608862998:84 , srv640972460:84 , srv67019657:84 , srv692215694:84 , srv766955776:84 , srv800327262:84 , srv831549665:84 , srv837033283:84 , srv848947116:84 , srv87007628:84 , srv875574280:84 , srv888017213:84 , srv909650890:84 , srv909995221:84 , srv914463049:84 , srv935844809:84 , srv941009413:84 , srv986853121:84 , srv991616696:84 , srv101628196:85 , srv1257476157:85 , srv1279913373:85 , srv1423334229:85 , srv1474530369:85 , srv198739656:85 , srv265197877:85 , srv694606959:85 , srv848827000:85 , srv169268386:684 }
2023-10-08 23:53:30,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:30,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290054410=57, srv875574280=91, srv675080681=81, srv1703483953=37, srv388707269=61, srv640972460=79, srv535005000=72, srv110685734=8, srv101628196=0, srv473538399=69, srv434874634=67, srv888017213=92, srv437530081=68, srv986853121=98, srv1086033965=6, srv2036103256=52, srv53513901=73, srv1068338829=3, srv421886858=65, srv1409648557=21, srv371792202=59, srv227372448=55, srv837033283=87, srv87007628=90, srv1931078015=45, srv2002643507=49, srv1659761932=33, srv1720378068=38, srv935844809=96, srv914463049=95, srv1962355654=47, srv1254154935=13, srv2034343313=51, srv1345689554=17, srv2016668291=50, srv160153811=30, srv67019657=80, srv1070047346=4, srv1102819869=7, srv355123265=58, srv800327262=85, srv1622047851=32, srv1832107263=40, srv941009413=97, srv848947116=89, srv1493638238=28, srv831549665=86, srv766955776=84, srv553640826=74, srv1229516360=11, srv1406938022=20, srv1961175174=46, srv603301655=75, srv1279913373=16, srv1549612517=29, srv198739656=48, srv909995221=94, srv209643334=53, srv692215694=82, srv909650890=93, srv405793279=63, srv1423334229=24, srv497802399=71, srv1077592461=5, srv265197877=56, srv41865380=64, srv1257476157=14, srv1381487427=18, srv1844283561=41, srv1663978293=34, srv187520020=42, srv1202085117=9, srv427809852=66, srv991616696=99, srv626716258=78, srv1606105431=31, srv1684730358=35, srv1230511196=12, srv1262045917=15, srv490480079=70, srv848827000=88, srv1440583003=25, srv381149044=60, srv1474530369=27, srv2133484236=54, srv1453554480=26, srv169268386=36, srv603561885=76, srv694606959=83, srv1420916089=22, srv1887150875=43, srv1202318923=10, srv608862998=77, srv1028479771=1, srv1399642723=19, srv1913596075=44, srv1423107319=23, srv1741059650=39, srv394100765=62, srv1046515551=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:30,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:30,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:30,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-08 23:53:30,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-08 23:53:30,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-08 23:53:30,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-08 23:53:30,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-08 23:53:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-08 23:53:30,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-08 23:53:31,102 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:31,102 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1381487427:83 , srv1703483953:83 , srv1844283561:83 , srv355123265:83 , srv434874634:83 , srv473538399:83 , srv553640826:83 , srv626716258:83 , srv675080681:83 , srv1028479771:84 , srv1046515551:84 , srv1068338829:84 , srv1070047346:84 , srv1077592461:84 , srv1086033965:84 , srv1102819869:84 , srv110685734:84 , srv1202085117:84 , srv1202318923:84 , srv1229516360:84 , srv1230511196:84 , srv1254154935:84 , srv1262045917:84 , srv1345689554:84 , srv1399642723:84 , srv1406938022:84 , srv1409648557:84 , srv1420916089:84 , srv1423107319:84 , srv1440583003:84 , srv1453554480:84 , srv1493638238:84 , srv1549612517:84 , srv160153811:84 , srv1606105431:84 , srv1622047851:84 , srv1659761932:84 , srv1663978293:84 , srv1684730358:84 , srv1720378068:84 , srv1741059650:84 , srv1832107263:84 , srv187520020:84 , srv1887150875:84 , srv1913596075:84 , srv1931078015:84 , srv1961175174:84 , srv1962355654:84 , srv2002643507:84 , srv2016668291:84 , srv2034343313:84 , srv2036103256:84 , srv209643334:84 , srv2133484236:84 , srv227372448:84 , srv290054410:84 , srv371792202:84 , srv381149044:84 , srv388707269:84 , srv394100765:84 , srv405793279:84 , srv41865380:84 , srv421886858:84 , srv427809852:84 , srv437530081:84 , srv490480079:84 , srv497802399:84 , srv535005000:84 , srv53513901:84 , srv603301655:84 , srv603561885:84 , srv608862998:84 , srv640972460:84 , srv67019657:84 , srv692215694:84 , srv766955776:84 , srv800327262:84 , srv831549665:84 , srv837033283:84 , srv848947116:84 , srv87007628:84 , srv875574280:84 , srv888017213:84 , srv909650890:84 , srv909995221:84 , srv914463049:84 , srv935844809:84 , srv941009413:84 , srv986853121:84 , srv991616696:84 , srv101628196:85 , srv1257476157:85 , srv1279913373:85 , srv1423334229:85 , srv1474530369:85 , srv198739656:85 , srv265197877:85 , srv694606959:85 , srv848827000:85 , srv169268386:684 }
2023-10-08 23:53:31,137 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 225) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=8667 (was 8683)
2023-10-08 23:53:31,147 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=169, AvailableMemoryMB=8667
2023-10-08 23:53:31,148 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-08 23:53:31,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-08 23:53:31,160 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002156515:84 , srv1087380093:84 , srv1215460537:84 , srv1268501605:84 , srv1382105582:84 , srv1530972334:84 , srv1552985677:84 , srv1581638430:84 , srv1608420412:84 , srv1618673107:84 , srv1640048298:84 , srv1670051618:84 , srv1673562960:84 , srv1749857725:84 , srv1906820612:84 , srv2102254540:84 , srv2120655810:84 , srv2132575478:84 , srv2137904943:84 , srv298529145:84 , srv404607548:84 , srv418473618:84 , srv478760459:84 , srv539555913:84 , srv577289551:84 , srv59733512:84 , srv723605668:84 , srv803596963:84 , srv962826359:84 , srv1404294750:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-08 23:53:31,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:53:31,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2132575478=18, srv1673562960=13, srv1002156515=0, srv1268501605=3, srv478760459=23, srv1608420412=9, srv1670051618=12, srv723605668=27, srv1640048298=11, srv2137904943=19, srv1581638430=8, srv2120655810=17, srv539555913=24, srv298529145=20, srv1906820612=15, srv2102254540=16, srv1404294750=5, srv1087380093=1, srv59733512=26, srv962826359=29, srv418473618=22, srv1382105582=4, srv1618673107=10, srv803596963=28, srv404607548=21, srv1215460537=2, srv1749857725=14, srv1552985677=7, srv1530972334=6, srv577289551=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:53:31,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:53:31,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:53:31,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-08 23:53:31,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.068231507739779, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:53:31,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912408038517205, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.068231507739779, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-08 23:55:31,183 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6142097 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.9912408038517205 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:55:31,189 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002156515:90 , srv1087380093:90 , srv1215460537:90 , srv1268501605:90 , srv1382105582:90 , srv1404294750:90 , srv1530972334:90 , srv1552985677:90 , srv1581638430:90 , srv1608420412:90 , srv1618673107:90 , srv1640048298:90 , srv1670051618:90 , srv1673562960:90 , srv1749857725:90 , srv1906820612:90 , srv2102254540:90 , srv2120655810:90 , srv2132575478:90 , srv2137904943:90 , srv298529145:90 , srv404607548:90 , srv418473618:90 , srv478760459:90 , srv539555913:90 , srv577289551:90 , srv59733512:90 , srv723605668:90 , srv803596963:90 , srv962826359:90 }
2023-10-08 23:55:31,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-08 23:55:31,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2132575478=18, srv1673562960=13, srv1002156515=0, srv1268501605=3, srv478760459=23, srv1608420412=9, srv1670051618=12, srv723605668=27, srv1640048298=11, srv2137904943=19, srv1581638430=8, srv2120655810=17, srv539555913=24, srv298529145=20, srv1906820612=15, srv2102254540=16, srv1404294750=5, srv1087380093=1, srv59733512=26, srv962826359=29, srv418473618=22, srv1382105582=4, srv1618673107=10, srv803596963=28, srv404607548=21, srv1215460537=2, srv1749857725=14, srv1552985677=7, srv1530972334=6, srv577289551=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-08 23:55:31,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-08 23:55:31,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-08 23:55:31,207 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-08 23:55:31,208 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1002156515:90 , srv1087380093:90 , srv1215460537:90 , srv1268501605:90 , srv1382105582:90 , srv1404294750:90 , srv1530972334:90 , srv1552985677:90 , srv1581638430:90 , srv1608420412:90 , srv1618673107:90 , srv1640048298:90 , srv1670051618:90 , srv1673562960:90 , srv1749857725:90 , srv1906820612:90 , srv2102254540:90 , srv2120655810:90 , srv2132575478:90 , srv2137904943:90 , srv298529145:90 , srv404607548:90 , srv418473618:90 , srv478760459:90 , srv539555913:90 , srv577289551:90 , srv59733512:90 , srv723605668:90 , srv803596963:90 , srv962826359:90 }
2023-10-08 23:55:31,222 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 272), ProcessCount=167 (was 169), AvailableMemoryMB=7728 (was 8667)