2024-04-09 16:54:09,957 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.normalizer.TestRegionNormalizerWorker timeout: 13 mins 2024-04-09 16:54:10,074 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.normalizer.TestRegionNormalizerWorker#testRateLimit Thread=9, OpenFileDescriptor=283, MaxFileDescriptor=60000, SystemLoadAverage=1540, ProcessCount=197, AvailableMemoryMB=1439 2024-04-09 16:54:11,896 INFO [Time-limited test] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to 1 MB/sec 2024-04-09 16:54:11,914 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-09 16:54:11,930 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(288): Rate limiting delayed this operation by PT0S 2024-04-09 16:54:11,945 INFO [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(299): Submitted SplitNormalizationPlan[splitTarget=NormalizationTarget[regionInfo={ENCODED => 9c37f9cddb9daacd0295f577fb7c5eb6, NAME => 'testRateLimit,,1712681651739.9c37f9cddb9daacd0295f577fb7c5eb6.', STARTKEY => '', ENDKEY => ''},regionSizeMb=2]] resulting in pid 1 2024-04-09 16:54:11,951 INFO [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(269): Submitted MergeNormalizationPlan[normalizationTargets=[NormalizationTarget[regionInfo={ENCODED => 9c37f9cddb9daacd0295f577fb7c5eb6, NAME => 'testRateLimit,,1712681651739.9c37f9cddb9daacd0295f577fb7c5eb6.', STARTKEY => '', ENDKEY => ''},regionSizeMb=1], NormalizationTarget[regionInfo={ENCODED => 9c37f9cddb9daacd0295f577fb7c5eb6, NAME => 'testRateLimit,,1712681651739.9c37f9cddb9daacd0295f577fb7c5eb6.', STARTKEY => '', ENDKEY => ''},regionSizeMb=2]]] resulting in pid 1 2024-04-09 16:54:13,907 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(271): Rate limiting delayed the worker by PT2S 2024-04-09 16:54:16,904 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(288): Rate limiting delayed this operation by PT3S 2024-04-09 16:54:16,905 INFO [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(299): Submitted SplitNormalizationPlan[splitTarget=NormalizationTarget[regionInfo={ENCODED => 9c37f9cddb9daacd0295f577fb7c5eb6, NAME => 'testRateLimit,,1712681651739.9c37f9cddb9daacd0295f577fb7c5eb6.', STARTKEY => '', ENDKEY => ''},regionSizeMb=1]] resulting in pid 1 2024-04-09 16:54:16,958 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-09 16:54:16,965 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-09 16:54:17,013 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.normalizer.TestRegionNormalizerWorker#testRateLimit Thread=10 (was 9) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=290 (was 283) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1545 (was 1540) - SystemLoadAverage LEAK? -, ProcessCount=195 (was 197), AvailableMemoryMB=650 (was 1439) 2024-04-09 16:54:17,040 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.normalizer.TestRegionNormalizerWorker#testMergeCounter Thread=10, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=1545, ProcessCount=195, AvailableMemoryMB=648 2024-04-09 16:54:17,095 INFO [Time-limited test] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-09 16:54:17,108 INFO [TestRegionNormalizerWorker-testMergeCounter-0] normalizer.RegionNormalizerWorker(269): Submitted MergeNormalizationPlan[normalizationTargets=[NormalizationTarget[regionInfo={ENCODED => ffa4b59c077571cf3250ea3a871bac66, NAME => 'testMergeCounter,,1712681657095.ffa4b59c077571cf3250ea3a871bac66.', STARTKEY => '', ENDKEY => ''},regionSizeMb=10], NormalizationTarget[regionInfo={ENCODED => ffa4b59c077571cf3250ea3a871bac66, NAME => 'testMergeCounter,,1712681657095.ffa4b59c077571cf3250ea3a871bac66.', STARTKEY => '', ENDKEY => ''},regionSizeMb=20]]] resulting in pid 1 2024-04-09 16:54:17,109 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-09 16:54:17,116 DEBUG [TestRegionNormalizerWorker-testMergeCounter-0] normalizer.RegionNormalizerWorker(271): Rate limiting delayed the worker by PT0S 2024-04-09 16:54:17,117 DEBUG [TestRegionNormalizerWorker-testMergeCounter-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-09 16:54:17,137 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.normalizer.TestRegionNormalizerWorker#testMergeCounter Thread=11 (was 10) - Thread LEAK? -, OpenFileDescriptor=290 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1545 (was 1545), ProcessCount=195 (was 195), AvailableMemoryMB=641 (was 648) 2024-04-09 16:54:17,210 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.normalizer.TestRegionNormalizerWorker#testSplitCounter Thread=11, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=1545, ProcessCount=195, AvailableMemoryMB=624 2024-04-09 16:54:17,227 INFO [Time-limited test] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-09 16:54:17,259 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-09 16:54:17,279 DEBUG [TestRegionNormalizerWorker-testSplitCounter-0] normalizer.RegionNormalizerWorker(288): Rate limiting delayed this operation by PT0S 2024-04-09 16:54:17,301 INFO [TestRegionNormalizerWorker-testSplitCounter-0] normalizer.RegionNormalizerWorker(299): Submitted SplitNormalizationPlan[splitTarget=NormalizationTarget[regionInfo={ENCODED => 07a5abfeb2094e400d27a80dcd371bff, NAME => 'testSplitCounter,,1712681657227.07a5abfeb2094e400d27a80dcd371bff.', STARTKEY => '', ENDKEY => ''},regionSizeMb=10]] resulting in pid 1 2024-04-09 16:54:17,361 DEBUG [TestRegionNormalizerWorker-testSplitCounter-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-09 16:54:17,395 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.normalizer.TestRegionNormalizerWorker#testSplitCounter Thread=11 (was 11), OpenFileDescriptor=290 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1545 (was 1545), ProcessCount=195 (was 195), AvailableMemoryMB=621 (was 624)