2023-07-18 04:56:30,381 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins
2023-07-18 04:56:30,556 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout
2023-07-18 04:56:30,587 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=170, AvailableMemoryMB=7137
2023-07-18 04:56:30,614 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 04:56:30,622 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 04:56:30,638 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 04:56:30,640 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 04:56:31,824 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 04:56:31,826 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 04:56:31,837 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 200), ProcessCount=170 (was 170), AvailableMemoryMB=7083 (was 7137)
2023-07-18 04:56:31,846 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=170, AvailableMemoryMB=7083
2023-07-18 04:56:31,863 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 04:56:31,879 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 04:56:31,880 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 04:56:31,882 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 04:56:32,982 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 04:56:32,983 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 04:56:32,991 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 185), ProcessCount=170 (was 170), AvailableMemoryMB=7616 (was 7083) - AvailableMemoryMB LEAK? -
2023-07-18 04:56:33,000 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=170, AvailableMemoryMB=7612
2023-07-18 04:56:33,025 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 04:56:33,052 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 04:56:33,053 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 04:56:33,054 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 04:56:35,260 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 04:56:35,260 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 04:56:35,268 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 185), ProcessCount=170 (was 170), AvailableMemoryMB=7332 (was 7612)
2023-07-18 04:56:35,276 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=170, AvailableMemoryMB=7332
2023-07-18 04:56:35,289 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 04:56:35,298 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 04:56:35,301 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 04:56:35,302 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 04:56:35,302 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 04:56:35,303 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 04:56:35,311 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10)
Potentially hanging thread: Time-limited test-BucketCacheWriter-0
	sun.misc.Unsafe.compareAndSwapLong(Native Method)
	java.util.concurrent.atomic.Striped64.casBase(Striped64.java:171)
	java.util.concurrent.atomic.LongAdder.add(LongAdder.java:86)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.freeBucketEntry(BucketCache.java:586)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.lambda$createRecycler$2(BucketCache.java:660)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$$Lambda$38/1441779710.free(Unknown Source)
	org.apache.hadoop.hbase.nio.RefCnt.deallocate(RefCnt.java:95)
	org.apache.hbase.thirdparty.io.netty.util.AbstractReferenceCounted.handleRelease(AbstractReferenceCounted.java:86)
	org.apache.hbase.thirdparty.io.netty.util.AbstractReferenceCounted.release(AbstractReferenceCounted.java:76)
	org.apache.hadoop.hbase.nio.RefCnt.release(RefCnt.java:84)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.release(BucketEntry.java:247)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.markAsEvicted(BucketEntry.java:174)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.blockEvicted(BucketCache.java:572)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.lambda$doDrain$7(BucketCache.java:1127)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$$Lambda$46/558328445.handle(Unknown Source)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.withWriteLock(BucketEntry.java:216)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1125)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973)
 - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 185), ProcessCount=170 (was 170), AvailableMemoryMB=7301 (was 7332)
2023-07-18 04:56:35,322 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=170, AvailableMemoryMB=7301
2023-07-18 04:56:35,336 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 04:56:35,348 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 04:56:35,350 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 04:56:35,350 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 04:56:35,355 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 04:56:35,356 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 04:56:35,370 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 185), ProcessCount=170 (was 170), AvailableMemoryMB=7268 (was 7301)