2023-07-19 05:56:30,952 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins 2023-07-19 05:56:31,116 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 05:56:31,154 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=171, AvailableMemoryMB=7212 2023-07-19 05:56:31,192 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-19 05:56:31,203 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-19 05:56:31,216 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-19 05:56:31,218 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-19 05:56:32,401 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-19 05:56:32,403 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-19 05:56:32,413 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 178), ProcessCount=171 (was 171), AvailableMemoryMB=7162 (was 7212) 2023-07-19 05:56:32,421 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=171, AvailableMemoryMB=7162 2023-07-19 05:56:32,443 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-19 05:56:32,464 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-19 05:56:32,466 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-19 05:56:32,466 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-19 05:56:33,567 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-19 05:56:33,568 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-19 05:56:33,578 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 178), ProcessCount=171 (was 171), AvailableMemoryMB=7161 (was 7162) 2023-07-19 05:56:33,587 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=171, AvailableMemoryMB=7160 2023-07-19 05:56:33,598 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-19 05:56:33,610 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-19 05:56:33,611 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-19 05:56:33,612 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-19 05:56:35,816 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-19 05:56:35,817 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-19 05:56:35,826 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 164), ProcessCount=171 (was 171), AvailableMemoryMB=7458 (was 7160) - AvailableMemoryMB LEAK? - 2023-07-19 05:56:35,834 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=171, AvailableMemoryMB=7456 2023-07-19 05:56:35,848 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-19 05:56:35,862 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-19 05:56:35,864 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-19 05:56:35,866 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-19 05:56:35,867 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-19 05:56:35,867 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-19 05:56:35,876 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 java.lang.Throwable.getStackTraceElement(Native Method) java.lang.Throwable.getOurStackTrace(Throwable.java:828) java.lang.Throwable.getStackTrace(Throwable.java:817) org.apache.log4j.spi.LocationInfo.(LocationInfo.java:98) org.apache.log4j.spi.LoggingEvent.getLocationInformation(LoggingEvent.java:260) org.apache.log4j.helpers.PatternParser$ClassNamePatternConverter.getFullyQualifiedName(PatternParser.java:518) org.apache.log4j.helpers.PatternParser$NamedPatternConverter.convert(PatternParser.java:491) org.apache.log4j.helpers.PatternConverter.format(PatternConverter.java:63) org.apache.log4j.PatternLayout.format(PatternLayout.java:510) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:303) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:981) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 164), ProcessCount=171 (was 171), AvailableMemoryMB=7420 (was 7456) 2023-07-19 05:56:35,885 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=171, AvailableMemoryMB=7418 2023-07-19 05:56:35,899 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-19 05:56:35,915 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-19 05:56:35,916 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-19 05:56:35,919 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-19 05:56:35,922 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-19 05:56:35,922 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-19 05:56:35,931 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 164), ProcessCount=171 (was 171), AvailableMemoryMB=7382 (was 7418)