2023-10-31 22:56:49,721 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-31 22:56:49,967 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-31 22:56:50,056 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-31 22:56:50,114 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-31 22:56:50,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-31 22:56:50,132 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=168, AvailableMemoryMB=7068
2023-10-31 22:56:50,134 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-31 22:56:50,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-31 22:56:50,263 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010745499:84 , srv1031176556:84 , srv1053108542:84 , srv1096600278:84 , srv1104951998:84 , srv1116762821:84 , srv1130439021:84 , srv1155068557:84 , srv1174777646:84 , srv1208797802:84 , srv1216414928:84 , srv1247530040:84 , srv1261548736:84 , srv1266634508:84 , srv1276239535:84 , srv1294652608:84 , srv1307977655:84 , srv1313694524:84 , srv134535381:84 , srv1370642004:84 , srv1383559089:84 , srv1388011619:84 , srv1418871355:84 , srv1478442968:84 , srv1491321164:84 , srv1523601603:84 , srv1526221043:84 , srv1529426748:84 , srv1548742950:84 , srv1555647333:84 , srv1593862567:84 , srv1597624316:84 , srv1609830792:84 , srv1613325758:84 , srv1613553753:84 , srv1684995490:84 , srv1715836591:84 , srv1729804933:84 , srv173231965:84 , srv175492709:84 , srv1795926573:84 , srv1822531475:84 , srv1829388784:84 , srv1858871581:84 , srv1886680572:84 , srv1903051535:84 , srv1941549275:84 , srv1951514056:84 , srv1964306632:84 , srv2006733707:84 , srv2011199814:84 , srv2049478626:84 , srv2050974535:84 , srv2136119491:84 , srv225960770:84 , srv236671034:84 , srv243726611:84 , srv24965072:84 , srv250870298:84 , srv261073357:84 , srv264958976:84 , srv287926262:84 , srv296028557:84 , srv338986112:84 , srv348268993:84 , srv411976554:84 , srv420207508:84 , srv455853683:84 , srv46857968:84 , srv488082694:84 , srv563731459:84 , srv565075120:84 , srv579841957:84 , srv595726273:84 , srv604453037:84 , srv61547451:84 , srv623850880:84 , srv626863702:84 , srv628547769:84 , srv649353218:84 , srv652206269:84 , srv655731025:84 , srv656313247:84 , srv6840088:84 , srv717234653:84 , srv718597043:84 , srv726983918:84 , srv737774314:84 , srv749585537:84 , srv780277372:84 , srv808800594:84 , srv825398134:84 , srv896605206:84 , srv901648557:84 , srv924366148:84 , srv935763510:84 , srv970960814:84 , srv99031891:84 , srv997095461:84 , srv1175725713:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-31 22:56:50,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:56:50,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595726273=74, srv1684995490=36, srv1096600278=3, srv1031176556=1, srv628547769=79, srv1593862567=31, srv411976554=66, srv604453037=75, srv225960770=55, srv175492709=40, srv1941549275=47, srv1613325758=34, srv1175725713=9, srv24965072=58, srv348268993=65, srv565075120=72, srv99031891=98, srv2050974535=53, srv1523601603=26, srv1951514056=48, srv1964306632=49, srv652206269=81, srv563731459=71, srv737774314=88, srv61547451=76, srv1116762821=5, srv726983918=87, srv1491321164=25, srv46857968=69, srv935763510=96, srv1370642004=20, srv623850880=77, srv1715836591=37, srv1858871581=44, srv1609830792=33, srv1053108542=2, srv1261548736=13, srv808800594=91, srv1829388784=43, srv287926262=62, srv2006733707=50, srv1174777646=8, srv1294652608=16, srv261073357=60, srv656313247=83, srv1104951998=4, srv1266634508=14, srv1418871355=23, srv264958976=61, srv1478442968=24, srv1903051535=46, srv1388011619=22, srv2136119491=54, srv780277372=90, srv1529426748=28, srv296028557=63, srv6840088=84, srv173231965=39, srv1155068557=7, srv2049478626=52, srv718597043=86, srv896605206=93, srv579841957=73, srv455853683=68, srv970960814=97, srv997095461=99, srv488082694=70, srv1208797802=10, srv901648557=94, srv1383559089=21, srv1313694524=18, srv2011199814=51, srv1597624316=32, srv1729804933=38, srv338986112=64, srv1886680572=45, srv236671034=56, srv243726611=57, srv1216414928=11, srv1130439021=6, srv825398134=92, srv250870298=59, srv655731025=82, srv1010745499=0, srv1822531475=42, srv1276239535=15, srv924366148=95, srv1548742950=29, srv1307977655=17, srv717234653=85, srv626863702=78, srv749585537=89, srv134535381=19, srv1795926573=41, srv420207508=67, srv1613553753=35, srv1247530040=12, srv1526221043=27, srv649353218=80, srv1555647333=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:56:50,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:56:50,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:56:50,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:56:50,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-31 22:56:50,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-31 22:56:50,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-31 22:56:50,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-31 22:56:50,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-31 22:56:50,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-31 22:56:50,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-31 22:56:50,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-31 22:56:50,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:50,604 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-31 22:56:50,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-31 22:56:50,991 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 619 ms to try 5000 different iterations.  Found a solution that moves 4671 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18240070766807304. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03813883054461864, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.052972262610356806, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.519, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03813883054461864, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.241, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,000 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1307977655:83 , srv1478442968:83 , srv1729804933:83 , srv2006733707:83 , srv348268993:83 , srv61547451:83 , srv649353218:83 , srv6840088:83 , srv901648557:83 , srv1388011619:84 , srv173231965:84 , srv175492709:84 , srv1829388784:84 , srv261073357:84 , srv420207508:84 , srv737774314:84 , srv780277372:84 , srv1031176556:85 , srv1096600278:85 , srv1130439021:85 , srv1174777646:85 , srv1247530040:85 , srv1276239535:85 , srv1526221043:85 , srv1609830792:85 , srv1684995490:85 , srv1795926573:85 , srv1822531475:85 , srv225960770:85 , srv243726611:85 , srv455853683:85 , srv595726273:85 , srv656313247:85 , srv924366148:85 , srv99031891:85 , srv997095461:85 , srv1053108542:86 , srv1208797802:86 , srv1294652608:86 , srv134535381:86 , srv1523601603:86 , srv1529426748:86 , srv1597624316:86 , srv1613325758:86 , srv1951514056:86 , srv2011199814:86 , srv2049478626:86 , srv2050974535:86 , srv24965072:86 , srv250870298:86 , srv604453037:86 , srv935763510:86 , srv1010745499:87 , srv1155068557:87 , srv1216414928:87 , srv1261548736:87 , srv1370642004:87 , srv1383559089:87 , srv1491321164:87 , srv1593862567:87 , srv2136119491:87 , srv338986112:87 , srv565075120:87 , srv579841957:87 , srv623850880:87 , srv655731025:87 , srv717234653:87 , srv726983918:87 , srv749585537:87 , srv1266634508:88 , srv1313694524:88 , srv1555647333:88 , srv1903051535:88 , srv264958976:88 , srv287926262:88 , srv296028557:88 , srv488082694:88 , srv626863702:88 , srv718597043:88 , srv825398134:88 , srv1104951998:89 , srv1116762821:89 , srv1418871355:89 , srv1548742950:89 , srv1613553753:89 , srv1715836591:89 , srv1886680572:89 , srv46857968:89 , srv628547769:89 , srv808800594:89 , srv970960814:89 , srv236671034:90 , srv411976554:90 , srv1858871581:91 , srv563731459:91 , srv896605206:91 , srv1941549275:93 , srv1964306632:94 , srv652206269:95 , srv1175725713:429 }
2023-10-31 22:56:51,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:56:51,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595726273=74, srv1684995490=36, srv1096600278=3, srv1031176556=1, srv628547769=79, srv1593862567=31, srv411976554=66, srv604453037=75, srv225960770=55, srv175492709=40, srv1941549275=47, srv1613325758=34, srv1175725713=9, srv24965072=58, srv348268993=65, srv565075120=72, srv99031891=98, srv2050974535=53, srv1523601603=26, srv1951514056=48, srv1964306632=49, srv652206269=81, srv563731459=71, srv737774314=88, srv61547451=76, srv1116762821=5, srv726983918=87, srv1491321164=25, srv46857968=69, srv935763510=96, srv1370642004=20, srv623850880=77, srv1715836591=37, srv1858871581=44, srv1609830792=33, srv1053108542=2, srv1261548736=13, srv808800594=91, srv1829388784=43, srv287926262=62, srv2006733707=50, srv1174777646=8, srv1294652608=16, srv261073357=60, srv656313247=83, srv1104951998=4, srv1266634508=14, srv1418871355=23, srv264958976=61, srv1478442968=24, srv1903051535=46, srv1388011619=22, srv2136119491=54, srv780277372=90, srv1529426748=28, srv296028557=63, srv6840088=84, srv173231965=39, srv1155068557=7, srv2049478626=52, srv718597043=86, srv896605206=93, srv579841957=73, srv455853683=68, srv970960814=97, srv997095461=99, srv488082694=70, srv1208797802=10, srv901648557=94, srv1383559089=21, srv1313694524=18, srv2011199814=51, srv1597624316=32, srv1729804933=38, srv338986112=64, srv1886680572=45, srv236671034=56, srv243726611=57, srv1216414928=11, srv1130439021=6, srv825398134=92, srv250870298=59, srv655731025=82, srv1010745499=0, srv1822531475=42, srv1276239535=15, srv924366148=95, srv1548742950=29, srv1307977655=17, srv717234653=85, srv626863702=78, srv749585537=89, srv134535381=19, srv1795926573=41, srv420207508=67, srv1613553753=35, srv1247530040=12, srv1526221043=27, srv649353218=80, srv1555647333=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:56:51,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:56:51,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-31 22:56:51,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-31 22:56:51,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-31 22:56:51,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-31 22:56:51,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-31 22:56:51,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-31 22:56:51,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-31 22:56:51,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03813883054461864, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.052972262610356806, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03813883054461864, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.241, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,133 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-31 22:56:51,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18236800062701145, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03813883054461864, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.052972262610356806, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03813883054461864, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.241, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-31 22:56:51,306 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 261 ms to try 5000 different iterations.  Found a solution that moves 2632 regions; Going from a computed imbalance of 0.18236800062701145 to a new imbalance of 0.015667461517800622. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021143869675180144); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03387108325081461, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29244444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021143869675180144); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,313 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1964306632:77 , srv1941549275:78 , srv652206269:80 , srv1116762821:81 , srv236671034:81 , srv1104951998:82 , srv1313694524:82 , srv1418871355:82 , srv1858871581:82 , srv411976554:82 , srv46857968:82 , srv563731459:82 , srv896605206:82 , srv1010745499:83 , srv1613553753:83 , srv2136119491:83 , srv264958976:83 , srv565075120:83 , srv579841957:83 , srv808800594:83 , srv825398134:83 , srv1261548736:84 , srv1383559089:84 , srv1715836591:84 , srv1886680572:84 , srv1903051535:84 , srv287926262:84 , srv749585537:84 , srv970960814:84 , srv1208797802:85 , srv1266634508:85 , srv1294652608:85 , srv134535381:85 , srv1548742950:85 , srv1555647333:85 , srv250870298:85 , srv296028557:85 , srv338986112:85 , srv488082694:85 , srv623850880:85 , srv626863702:85 , srv655731025:85 , srv717234653:85 , srv718597043:85 , srv99031891:85 , srv1031176556:86 , srv1053108542:86 , srv1155068557:86 , srv1216414928:86 , srv1370642004:86 , srv1491321164:86 , srv1529426748:86 , srv1593862567:86 , srv1609830792:86 , srv1684995490:86 , srv1951514056:86 , srv2011199814:86 , srv2049478626:86 , srv225960770:86 , srv595726273:86 , srv628547769:86 , srv656313247:86 , srv935763510:86 , srv1523601603:87 , srv1597624316:87 , srv1613325758:87 , srv175492709:87 , srv1795926573:87 , srv243726611:87 , srv24965072:87 , srv261073357:87 , srv455853683:87 , srv726983918:87 , srv997095461:87 , srv1096600278:88 , srv1174777646:88 , srv1247530040:88 , srv1276239535:88 , srv1388011619:88 , srv173231965:88 , srv1822531475:88 , srv1829388784:88 , srv2006733707:88 , srv2050974535:88 , srv348268993:88 , srv604453037:88 , srv61547451:88 , srv649353218:88 , srv6840088:88 , srv737774314:88 , srv780277372:88 , srv924366148:88 , srv1307977655:89 , srv1526221043:89 , srv1729804933:89 , srv901648557:89 , srv1130439021:91 , srv1478442968:91 , srv420207508:91 , srv1175725713:533 }
2023-10-31 22:56:51,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:56:51,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595726273=74, srv1684995490=36, srv1096600278=3, srv1031176556=1, srv628547769=79, srv1593862567=31, srv411976554=66, srv604453037=75, srv225960770=55, srv175492709=40, srv1941549275=47, srv1613325758=34, srv1175725713=9, srv24965072=58, srv348268993=65, srv565075120=72, srv99031891=98, srv2050974535=53, srv1523601603=26, srv1951514056=48, srv1964306632=49, srv652206269=81, srv563731459=71, srv737774314=88, srv61547451=76, srv1116762821=5, srv726983918=87, srv1491321164=25, srv46857968=69, srv935763510=96, srv1370642004=20, srv623850880=77, srv1715836591=37, srv1858871581=44, srv1609830792=33, srv1053108542=2, srv1261548736=13, srv808800594=91, srv1829388784=43, srv287926262=62, srv2006733707=50, srv1174777646=8, srv1294652608=16, srv261073357=60, srv656313247=83, srv1104951998=4, srv1266634508=14, srv1418871355=23, srv264958976=61, srv1478442968=24, srv1903051535=46, srv1388011619=22, srv2136119491=54, srv780277372=90, srv1529426748=28, srv296028557=63, srv6840088=84, srv173231965=39, srv1155068557=7, srv2049478626=52, srv718597043=86, srv896605206=93, srv579841957=73, srv455853683=68, srv970960814=97, srv997095461=99, srv488082694=70, srv1208797802=10, srv901648557=94, srv1383559089=21, srv1313694524=18, srv2011199814=51, srv1597624316=32, srv1729804933=38, srv338986112=64, srv1886680572=45, srv236671034=56, srv243726611=57, srv1216414928=11, srv1130439021=6, srv825398134=92, srv250870298=59, srv655731025=82, srv1010745499=0, srv1822531475=42, srv1276239535=15, srv924366148=95, srv1548742950=29, srv1307977655=17, srv717234653=85, srv626863702=78, srv749585537=89, srv134535381=19, srv1795926573=41, srv420207508=67, srv1613553753=35, srv1247530040=12, srv1526221043=27, srv649353218=80, srv1555647333=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:56:51,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:56:51,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-31 22:56:51,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-31 22:56:51,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-31 22:56:51,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-31 22:56:51,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-31 22:56:51,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-31 22:56:51,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-31 22:56:51,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-31 22:56:51,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-31 22:56:51,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-31 22:56:51,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-31 22:56:51,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021143869675180144); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03387108325081461, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021143869675180144); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,419 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-31 22:56:51,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015649031859895645, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021143869675180144); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03387108325081461, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021143869675180144); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-31 22:56:51,643 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 297 ms to try 5000 different iterations.  Found a solution that moves 1013 regions; Going from a computed imbalance of 0.015649031859895645 to a new imbalance of 5.138928202587012E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006209542957707027); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007610023515893884); MoveCostFunction : (multiplier=7.0, imbalance=0.11255555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006209542957707027); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,644 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1130439021:81 , srv420207508:82 , srv628547769:82 , srv1478442968:83 , srv1548742950:83 , srv2050974535:83 , srv652206269:83 , srv726983918:83 , srv1096600278:84 , srv1174777646:84 , srv1276239535:84 , srv1370642004:84 , srv1491321164:84 , srv1526221043:84 , srv1529426748:84 , srv1555647333:84 , srv1593862567:84 , srv1886680572:84 , srv24965072:84 , srv296028557:84 , srv488082694:84 , srv563731459:84 , srv604453037:84 , srv1155068557:85 , srv1216414928:85 , srv1247530040:85 , srv1266634508:85 , srv1307977655:85 , srv1523601603:85 , srv1597624316:85 , srv1613553753:85 , srv1715836591:85 , srv1729804933:85 , srv1822531475:85 , srv1829388784:85 , srv1858871581:85 , srv1951514056:85 , srv2011199814:85 , srv2049478626:85 , srv243726611:85 , srv338986112:85 , srv411976554:85 , srv455853683:85 , srv623850880:85 , srv626863702:85 , srv718597043:85 , srv780277372:85 , srv896605206:85 , srv924366148:85 , srv935763510:85 , srv970960814:85 , srv1031176556:86 , srv1053108542:86 , srv1104951998:86 , srv1208797802:86 , srv1261548736:86 , srv1294652608:86 , srv134535381:86 , srv1388011619:86 , srv1418871355:86 , srv1609830792:86 , srv1613325758:86 , srv173231965:86 , srv1795926573:86 , srv1941549275:86 , srv2006733707:86 , srv225960770:86 , srv236671034:86 , srv264958976:86 , srv287926262:86 , srv348268993:86 , srv46857968:86 , srv595726273:86 , srv649353218:86 , srv655731025:86 , srv656313247:86 , srv717234653:86 , srv737774314:86 , srv749585537:86 , srv808800594:86 , srv825398134:86 , srv901648557:86 , srv997095461:86 , srv1116762821:87 , srv1313694524:87 , srv1383559089:87 , srv1684995490:87 , srv175492709:87 , srv250870298:87 , srv261073357:87 , srv565075120:87 , srv579841957:87 , srv61547451:87 , srv6840088:87 , srv1010745499:88 , srv1903051535:88 , srv1964306632:88 , srv2136119491:88 , srv99031891:88 , srv1175725713:551 }
2023-10-31 22:56:51,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:56:51,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595726273=74, srv1684995490=36, srv1096600278=3, srv1031176556=1, srv628547769=79, srv1593862567=31, srv411976554=66, srv604453037=75, srv225960770=55, srv175492709=40, srv1941549275=47, srv1613325758=34, srv1175725713=9, srv24965072=58, srv348268993=65, srv565075120=72, srv99031891=98, srv2050974535=53, srv1523601603=26, srv1951514056=48, srv1964306632=49, srv652206269=81, srv563731459=71, srv737774314=88, srv61547451=76, srv1116762821=5, srv726983918=87, srv1491321164=25, srv46857968=69, srv935763510=96, srv1370642004=20, srv623850880=77, srv1715836591=37, srv1858871581=44, srv1609830792=33, srv1053108542=2, srv1261548736=13, srv808800594=91, srv1829388784=43, srv287926262=62, srv2006733707=50, srv1174777646=8, srv1294652608=16, srv261073357=60, srv656313247=83, srv1104951998=4, srv1266634508=14, srv1418871355=23, srv264958976=61, srv1478442968=24, srv1903051535=46, srv1388011619=22, srv2136119491=54, srv780277372=90, srv1529426748=28, srv296028557=63, srv6840088=84, srv173231965=39, srv1155068557=7, srv2049478626=52, srv718597043=86, srv896605206=93, srv579841957=73, srv455853683=68, srv970960814=97, srv997095461=99, srv488082694=70, srv1208797802=10, srv901648557=94, srv1383559089=21, srv1313694524=18, srv2011199814=51, srv1597624316=32, srv1729804933=38, srv338986112=64, srv1886680572=45, srv236671034=56, srv243726611=57, srv1216414928=11, srv1130439021=6, srv825398134=92, srv250870298=59, srv655731025=82, srv1010745499=0, srv1822531475=42, srv1276239535=15, srv924366148=95, srv1548742950=29, srv1307977655=17, srv717234653=85, srv626863702=78, srv749585537=89, srv134535381=19, srv1795926573=41, srv420207508=67, srv1613553753=35, srv1247530040=12, srv1526221043=27, srv649353218=80, srv1555647333=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:56:51,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:56:51,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:56:51,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:56:51,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:56:51,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-31 22:56:51,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-31 22:56:51,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-31 22:56:51,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-31 22:56:51,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-31 22:56:51,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-31 22:56:51,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-31 22:56:51,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-31 22:56:51,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-31 22:56:51,743 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006209542957707027); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007610023515893884); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006209542957707027); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,743 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-31 22:56:51,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.067996426531763E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006209542957707027); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007610023515893884); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006209542957707027); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-31 22:56:51,894 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 219 ms to try 5000 different iterations.  Found a solution that moves 218 regions; Going from a computed imbalance of 5.067996426531763E-4 to a new imbalance of 1.9159903367163088E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.02422222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,894 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1903051535:82 , srv1613325758:83 , srv1964306632:83 , srv261073357:83 , srv717234653:83 , srv1010745499:84 , srv1031176556:84 , srv1053108542:84 , srv1155068557:84 , srv1216414928:84 , srv1247530040:84 , srv1266634508:84 , srv1383559089:84 , srv1388011619:84 , srv1523601603:84 , srv1526221043:84 , srv1597624316:84 , srv1684995490:84 , srv1715836591:84 , srv173231965:84 , srv175492709:84 , srv1795926573:84 , srv1858871581:84 , srv250870298:84 , srv264958976:84 , srv287926262:84 , srv46857968:84 , srv565075120:84 , srv579841957:84 , srv61547451:84 , srv649353218:84 , srv652206269:84 , srv718597043:84 , srv737774314:84 , srv896605206:84 , srv901648557:84 , srv924366148:84 , srv970960814:84 , srv99031891:84 , srv997095461:84 , srv1096600278:85 , srv1104951998:85 , srv1116762821:85 , srv1130439021:85 , srv1174777646:85 , srv1208797802:85 , srv1261548736:85 , srv1276239535:85 , srv1294652608:85 , srv1307977655:85 , srv1313694524:85 , srv134535381:85 , srv1370642004:85 , srv1418871355:85 , srv1478442968:85 , srv1491321164:85 , srv1548742950:85 , srv1555647333:85 , srv1593862567:85 , srv1609830792:85 , srv1613553753:85 , srv1729804933:85 , srv1822531475:85 , srv1829388784:85 , srv1886680572:85 , srv1941549275:85 , srv1951514056:85 , srv2006733707:85 , srv2011199814:85 , srv2049478626:85 , srv2050974535:85 , srv2136119491:85 , srv225960770:85 , srv236671034:85 , srv243726611:85 , srv24965072:85 , srv296028557:85 , srv338986112:85 , srv348268993:85 , srv420207508:85 , srv455853683:85 , srv488082694:85 , srv563731459:85 , srv595726273:85 , srv604453037:85 , srv623850880:85 , srv626863702:85 , srv628547769:85 , srv655731025:85 , srv656313247:85 , srv6840088:85 , srv726983918:85 , srv749585537:85 , srv780277372:85 , srv808800594:85 , srv825398134:85 , srv935763510:85 , srv1529426748:86 , srv411976554:86 , srv1175725713:629 }
2023-10-31 22:56:51,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:56:51,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595726273=74, srv1684995490=36, srv1096600278=3, srv1031176556=1, srv628547769=79, srv1593862567=31, srv411976554=66, srv604453037=75, srv225960770=55, srv175492709=40, srv1941549275=47, srv1613325758=34, srv1175725713=9, srv24965072=58, srv348268993=65, srv565075120=72, srv99031891=98, srv2050974535=53, srv1523601603=26, srv1951514056=48, srv1964306632=49, srv652206269=81, srv563731459=71, srv737774314=88, srv61547451=76, srv1116762821=5, srv726983918=87, srv1491321164=25, srv46857968=69, srv935763510=96, srv1370642004=20, srv623850880=77, srv1715836591=37, srv1858871581=44, srv1609830792=33, srv1053108542=2, srv1261548736=13, srv808800594=91, srv1829388784=43, srv287926262=62, srv2006733707=50, srv1174777646=8, srv1294652608=16, srv261073357=60, srv656313247=83, srv1104951998=4, srv1266634508=14, srv1418871355=23, srv264958976=61, srv1478442968=24, srv1903051535=46, srv1388011619=22, srv2136119491=54, srv780277372=90, srv1529426748=28, srv296028557=63, srv6840088=84, srv173231965=39, srv1155068557=7, srv2049478626=52, srv718597043=86, srv896605206=93, srv579841957=73, srv455853683=68, srv970960814=97, srv997095461=99, srv488082694=70, srv1208797802=10, srv901648557=94, srv1383559089=21, srv1313694524=18, srv2011199814=51, srv1597624316=32, srv1729804933=38, srv338986112=64, srv1886680572=45, srv236671034=56, srv243726611=57, srv1216414928=11, srv1130439021=6, srv825398134=92, srv250870298=59, srv655731025=82, srv1010745499=0, srv1822531475=42, srv1276239535=15, srv924366148=95, srv1548742950=29, srv1307977655=17, srv717234653=85, srv626863702=78, srv749585537=89, srv134535381=19, srv1795926573=41, srv420207508=67, srv1613553753=35, srv1247530040=12, srv1526221043=27, srv649353218=80, srv1555647333=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:56:51,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:56:51,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-31 22:56:51,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-31 22:56:51,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-31 22:56:51,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-31 22:56:51,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-31 22:56:51,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-31 22:56:51,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-31 22:56:51,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-31 22:56:51,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-31 22:56:51,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-31 22:56:51,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-31 22:56:51,993 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7633434741294947E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:51,994 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1903051535:82 , srv1613325758:83 , srv1964306632:83 , srv261073357:83 , srv717234653:83 , srv1010745499:84 , srv1031176556:84 , srv1053108542:84 , srv1155068557:84 , srv1216414928:84 , srv1247530040:84 , srv1266634508:84 , srv1383559089:84 , srv1388011619:84 , srv1523601603:84 , srv1526221043:84 , srv1597624316:84 , srv1684995490:84 , srv1715836591:84 , srv173231965:84 , srv175492709:84 , srv1795926573:84 , srv1858871581:84 , srv250870298:84 , srv264958976:84 , srv287926262:84 , srv46857968:84 , srv565075120:84 , srv579841957:84 , srv61547451:84 , srv649353218:84 , srv652206269:84 , srv718597043:84 , srv737774314:84 , srv896605206:84 , srv901648557:84 , srv924366148:84 , srv970960814:84 , srv99031891:84 , srv997095461:84 , srv1096600278:85 , srv1104951998:85 , srv1116762821:85 , srv1130439021:85 , srv1174777646:85 , srv1208797802:85 , srv1261548736:85 , srv1276239535:85 , srv1294652608:85 , srv1307977655:85 , srv1313694524:85 , srv134535381:85 , srv1370642004:85 , srv1418871355:85 , srv1478442968:85 , srv1491321164:85 , srv1548742950:85 , srv1555647333:85 , srv1593862567:85 , srv1609830792:85 , srv1613553753:85 , srv1729804933:85 , srv1822531475:85 , srv1829388784:85 , srv1886680572:85 , srv1941549275:85 , srv1951514056:85 , srv2006733707:85 , srv2011199814:85 , srv2049478626:85 , srv2050974535:85 , srv2136119491:85 , srv225960770:85 , srv236671034:85 , srv243726611:85 , srv24965072:85 , srv296028557:85 , srv338986112:85 , srv348268993:85 , srv420207508:85 , srv455853683:85 , srv488082694:85 , srv563731459:85 , srv595726273:85 , srv604453037:85 , srv623850880:85 , srv626863702:85 , srv628547769:85 , srv655731025:85 , srv656313247:85 , srv6840088:85 , srv726983918:85 , srv749585537:85 , srv780277372:85 , srv808800594:85 , srv825398134:85 , srv935763510:85 , srv1529426748:86 , srv411976554:86 , srv1175725713:629 }
2023-10-31 22:56:52,017 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 223), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=6571 (was 7068)
2023-10-31 22:56:52,023 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=170, AvailableMemoryMB=6571
2023-10-31 22:56:52,024 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-31 22:56:52,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-31 22:56:52,033 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048117864:84 , srv1111060798:84 , srv1118397048:84 , srv1248810505:84 , srv1273395192:84 , srv1273532271:84 , srv1345672796:84 , srv135862970:84 , srv1435030286:84 , srv1483062221:84 , srv1788945625:84 , srv1956922489:84 , srv2028216908:84 , srv2052778286:84 , srv2108114325:84 , srv245382099:84 , srv454695514:84 , srv495302253:84 , srv49773:84 , srv521883927:84 , srv554485000:84 , srv651337888:84 , srv801963445:84 , srv80367787:84 , srv851726594:84 , srv89425910:84 , srv932480008:84 , srv936475567:84 , srv981159826:84 , srv1097288453:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-31 22:56:52,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:56:52,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1273395192=5, srv2028216908=13, srv495302253=18, srv1345672796=7, srv1118397048=3, srv2052778286=14, srv1111060798=2, srv1273532271=6, srv1048117864=0, srv981159826=29, srv1435030286=9, srv49773=19, srv1248810505=4, srv1788945625=11, srv135862970=8, srv1956922489=12, srv245382099=16, srv851726594=25, srv554485000=21, srv454695514=17, srv936475567=28, srv89425910=26, srv2108114325=15, srv651337888=22, srv80367787=24, srv1097288453=1, srv1483062221=10, srv801963445=23, srv521883927=20, srv932480008=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:56:52,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:56:52,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:56:52,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-31 22:56:52,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.080946251579834, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:56:52,061 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991244810225987, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.080946251579834, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-31 22:58:52,049 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9344114 different iterations.  Found a solution that moves 1836 regions; Going from a computed imbalance of 0.991244810225987 to a new imbalance of 4.2853155918867096E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.68, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:58:52,055 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1048117864:90 , srv1097288453:90 , srv1111060798:90 , srv1118397048:90 , srv1248810505:90 , srv1273395192:90 , srv1273532271:90 , srv1345672796:90 , srv135862970:90 , srv1435030286:90 , srv1483062221:90 , srv1788945625:90 , srv1956922489:90 , srv2028216908:90 , srv2052778286:90 , srv2108114325:90 , srv245382099:90 , srv454695514:90 , srv495302253:90 , srv49773:90 , srv521883927:90 , srv554485000:90 , srv651337888:90 , srv801963445:90 , srv80367787:90 , srv851726594:90 , srv89425910:90 , srv932480008:90 , srv936475567:90 , srv981159826:90 }
2023-10-31 22:58:52,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-31 22:58:52,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1273395192=5, srv2028216908=13, srv495302253=18, srv1345672796=7, srv1118397048=3, srv2052778286=14, srv1111060798=2, srv1273532271=6, srv1048117864=0, srv981159826=29, srv1435030286=9, srv49773=19, srv1248810505=4, srv1788945625=11, srv135862970=8, srv1956922489=12, srv245382099=16, srv851726594=25, srv554485000=21, srv454695514=17, srv936475567=28, srv89425910=26, srv2108114325=15, srv651337888=22, srv80367787=24, srv1097288453=1, srv1483062221=10, srv801963445=23, srv521883927=20, srv932480008=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-31 22:58:52,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-31 22:58:52,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-31 22:58:52,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-31 22:58:52,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-31 22:58:52,071 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-31 22:58:52,072 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1048117864:90 , srv1097288453:90 , srv1111060798:90 , srv1118397048:90 , srv1248810505:90 , srv1273395192:90 , srv1273532271:90 , srv1345672796:90 , srv135862970:90 , srv1435030286:90 , srv1483062221:90 , srv1788945625:90 , srv1956922489:90 , srv2028216908:90 , srv2052778286:90 , srv2108114325:90 , srv245382099:90 , srv454695514:90 , srv495302253:90 , srv49773:90 , srv521883927:90 , srv554485000:90 , srv651337888:90 , srv801963445:90 , srv80367787:90 , srv851726594:90 , srv89425910:90 , srv932480008:90 , srv936475567:90 , srv981159826:90 }
2023-10-31 22:58:52,083 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 223) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 170), AvailableMemoryMB=6682 (was 6571) - AvailableMemoryMB LEAK? -