2023-07-20 23:56:19,020 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins 2023-07-20 23:56:19,214 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 23:56:19,251 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=170, AvailableMemoryMB=7250 2023-07-20 23:56:19,284 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-20 23:56:19,295 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-20 23:56:19,309 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-20 23:56:19,310 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-20 23:56:20,503 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-20 23:56:20,506 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-20 23:56:20,517 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 202), ProcessCount=170 (was 170), AvailableMemoryMB=7094 (was 7250) 2023-07-20 23:56:20,527 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=170, AvailableMemoryMB=7086 2023-07-20 23:56:20,544 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-20 23:56:20,574 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-20 23:56:20,576 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-20 23:56:20,576 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-20 23:56:21,678 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-20 23:56:21,678 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-20 23:56:21,687 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 202), ProcessCount=170 (was 170), AvailableMemoryMB=6948 (was 7086) 2023-07-20 23:56:21,696 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=170, AvailableMemoryMB=6947 2023-07-20 23:56:21,712 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-20 23:56:21,722 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-20 23:56:21,723 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-20 23:56:21,724 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-20 23:56:23,930 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-20 23:56:23,930 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-20 23:56:23,940 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=6831 (was 6947) 2023-07-20 23:56:23,950 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=170, AvailableMemoryMB=6831 2023-07-20 23:56:23,966 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-20 23:56:23,983 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-20 23:56:23,985 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-20 23:56:23,986 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-20 23:56:23,986 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-20 23:56:23,988 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-20 23:56:23,998 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$$Lambda$46/1494555521.handle(Unknown Source) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.withWriteLock(BucketEntry.java:216) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1125) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 266), ProcessCount=170 (was 170), AvailableMemoryMB=6797 (was 6831) 2023-07-20 23:56:24,008 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=170, AvailableMemoryMB=6796 2023-07-20 23:56:24,020 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-20 23:56:24,032 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-20 23:56:24,034 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-20 23:56:24,034 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-20 23:56:24,039 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-20 23:56:24,040 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-20 23:56:24,049 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 266), ProcessCount=170 (was 170), AvailableMemoryMB=6762 (was 6796)