2024-04-19 11:53:44,892 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.normalizer.TestRegionNormalizerWorker timeout: 13 mins 2024-04-19 11:53:44,941 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.normalizer.TestRegionNormalizerWorker#testRateLimit Thread=9, OpenFileDescriptor=282, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=167, AvailableMemoryMB=2448 2024-04-19 11:53:45,910 INFO [Time-limited test] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to 1 MB/sec 2024-04-19 11:53:45,928 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(288): Rate limiting delayed this operation by PT0S 2024-04-19 11:53:45,928 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-19 11:53:45,939 INFO [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(299): Submitted SplitNormalizationPlan[splitTarget=NormalizationTarget[regionInfo={ENCODED => 2f63d40e069a9118db912c632f15c034, NAME => 'testRateLimit,,1713527625847.2f63d40e069a9118db912c632f15c034.', STARTKEY => '', ENDKEY => ''},regionSizeMb=2]] resulting in pid 1 2024-04-19 11:53:45,944 INFO [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(269): Submitted MergeNormalizationPlan[normalizationTargets=[NormalizationTarget[regionInfo={ENCODED => 2f63d40e069a9118db912c632f15c034, NAME => 'testRateLimit,,1713527625847.2f63d40e069a9118db912c632f15c034.', STARTKEY => '', ENDKEY => ''},regionSizeMb=1], NormalizationTarget[regionInfo={ENCODED => 2f63d40e069a9118db912c632f15c034, NAME => 'testRateLimit,,1713527625847.2f63d40e069a9118db912c632f15c034.', STARTKEY => '', ENDKEY => ''},regionSizeMb=2]]] resulting in pid 1 2024-04-19 11:53:47,919 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(271): Rate limiting delayed the worker by PT2S 2024-04-19 11:53:50,918 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(288): Rate limiting delayed this operation by PT3S 2024-04-19 11:53:50,918 INFO [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(299): Submitted SplitNormalizationPlan[splitTarget=NormalizationTarget[regionInfo={ENCODED => 2f63d40e069a9118db912c632f15c034, NAME => 'testRateLimit,,1713527625847.2f63d40e069a9118db912c632f15c034.', STARTKEY => '', ENDKEY => ''},regionSizeMb=1]] resulting in pid 1 2024-04-19 11:53:50,934 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-19 11:53:50,935 DEBUG [TestRegionNormalizerWorker-testRateLimit-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-19 11:53:50,957 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.normalizer.TestRegionNormalizerWorker#testRateLimit Thread=10 (was 9) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=289 (was 282) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=169 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2303 (was 2448) 2024-04-19 11:53:50,966 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.normalizer.TestRegionNormalizerWorker#testMergeCounter Thread=10, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=169, AvailableMemoryMB=2303 2024-04-19 11:53:50,976 INFO [Time-limited test] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-19 11:53:50,978 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-19 11:53:50,978 INFO [TestRegionNormalizerWorker-testMergeCounter-0] normalizer.RegionNormalizerWorker(269): Submitted MergeNormalizationPlan[normalizationTargets=[NormalizationTarget[regionInfo={ENCODED => 5150041e79aa54acd640f836e4e873d3, NAME => 'testMergeCounter,,1713527630976.5150041e79aa54acd640f836e4e873d3.', STARTKEY => '', ENDKEY => ''},regionSizeMb=10], NormalizationTarget[regionInfo={ENCODED => 5150041e79aa54acd640f836e4e873d3, NAME => 'testMergeCounter,,1713527630976.5150041e79aa54acd640f836e4e873d3.', STARTKEY => '', ENDKEY => ''},regionSizeMb=20]]] resulting in pid 1 2024-04-19 11:53:50,979 DEBUG [TestRegionNormalizerWorker-testMergeCounter-0] normalizer.RegionNormalizerWorker(271): Rate limiting delayed the worker by PT0S 2024-04-19 11:53:50,979 DEBUG [TestRegionNormalizerWorker-testMergeCounter-0] normalizer.RegionNormalizerWorker(167): interrupt detected. terminating. 2024-04-19 11:53:50,991 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.normalizer.TestRegionNormalizerWorker#testMergeCounter Thread=10 (was 10), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=169 (was 169), AvailableMemoryMB=2301 (was 2303) 2024-04-19 11:53:51,001 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.normalizer.TestRegionNormalizerWorker#testSplitCounter Thread=10, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=169, AvailableMemoryMB=2301 2024-04-19 11:53:51,017 INFO [Time-limited test] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-19 11:53:51,019 DEBUG [TestRegionNormalizerWorker-testSplitCounter-0] normalizer.RegionNormalizerWorker(288): Rate limiting delayed this operation by PT0S 2024-04-19 11:53:51,019 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-19 11:53:51,020 INFO [TestRegionNormalizerWorker-testSplitCounter-0] normalizer.RegionNormalizerWorker(299): Submitted SplitNormalizationPlan[splitTarget=NormalizationTarget[regionInfo={ENCODED => 03b3d0119a82def3d449cc0031069237, NAME => 'testSplitCounter,,1713527631016.03b3d0119a82def3d449cc0031069237.', STARTKEY => '', ENDKEY => ''},regionSizeMb=10]] resulting in pid 1 2024-04-19 11:53:51,020 DEBUG [TestRegionNormalizerWorker-testSplitCounter-0] normalizer.RegionNormalizerWorker(167): interrupt detected. terminating. 2024-04-19 11:53:51,031 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.normalizer.TestRegionNormalizerWorker#testSplitCounter Thread=10 (was 10), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=169 (was 169), AvailableMemoryMB=2300 (was 2301)