2023-07-11 18:25:32,550 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins 2023-07-11 18:25:32,727 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 18:25:32,768 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=177, AvailableMemoryMB=4123 2023-07-11 18:25:32,796 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-11 18:25:32,809 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-11 18:25:32,828 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-11 18:25:32,830 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-11 18:25:34,009 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-11 18:25:34,011 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-11 18:25:34,022 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=177 (was 177), AvailableMemoryMB=4096 (was 4123) 2023-07-11 18:25:34,031 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=177, AvailableMemoryMB=4096 2023-07-11 18:25:34,050 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-11 18:25:34,075 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-11 18:25:34,077 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-11 18:25:34,078 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-11 18:25:35,179 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-11 18:25:35,180 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-11 18:25:35,190 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=175 (was 177), AvailableMemoryMB=6441 (was 4096) - AvailableMemoryMB LEAK? - 2023-07-11 18:25:35,200 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=175, AvailableMemoryMB=6441 2023-07-11 18:25:35,219 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-11 18:25:35,239 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-11 18:25:35,240 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-11 18:25:35,241 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-11 18:25:37,453 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-11 18:25:37,460 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-11 18:25:37,472 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=11 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:967) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 292) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=6190 (was 6441) 2023-07-11 18:25:37,485 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=175, AvailableMemoryMB=6190 2023-07-11 18:25:37,503 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-11 18:25:37,530 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-11 18:25:37,532 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-11 18:25:37,537 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-11 18:25:37,538 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-11 18:25:37,539 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-11 18:25:37,548 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 java.util.concurrent.ConcurrentHashMap.initTable(ConcurrentHashMap.java:2233) java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1017) java.util.concurrent.ConcurrentHashMap.putIfAbsent(ConcurrentHashMap.java:1535) org.apache.hadoop.hbase.util.ObjectPool.get(ObjectPool.java:165) org.apache.hadoop.hbase.util.IdReadWriteLock.getLock(IdReadWriteLock.java:94) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.withWriteLock(BucketEntry.java:213) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1125) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) - Thread LEAK? -, OpenFileDescriptor=263 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=175 (was 175), AvailableMemoryMB=6154 (was 6190) 2023-07-11 18:25:37,557 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=175, AvailableMemoryMB=6152 2023-07-11 18:25:37,571 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-11 18:25:37,585 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-11 18:25:37,587 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-11 18:25:37,594 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-11 18:25:37,598 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-11 18:25:37,599 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-11 18:25:37,610 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=175 (was 175), AvailableMemoryMB=6120 (was 6152)