2023-07-24 11:56:51,708 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins 2023-07-24 11:56:51,853 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 11:56:51,883 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=171, AvailableMemoryMB=9230 2023-07-24 11:56:51,910 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-24 11:56:51,924 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-24 11:56:51,937 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-24 11:56:51,938 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-24 11:56:53,115 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-24 11:56:53,117 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-24 11:56:53,126 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 168), ProcessCount=171 (was 171), AvailableMemoryMB=9188 (was 9230) 2023-07-24 11:56:53,134 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=171, AvailableMemoryMB=9188 2023-07-24 11:56:53,155 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-24 11:56:53,170 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-24 11:56:53,171 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-24 11:56:53,173 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-24 11:56:54,274 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-24 11:56:54,274 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-24 11:56:54,282 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 168), ProcessCount=171 (was 171), AvailableMemoryMB=9178 (was 9188) 2023-07-24 11:56:54,291 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=171, AvailableMemoryMB=9178 2023-07-24 11:56:54,305 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-24 11:56:54,314 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-24 11:56:54,315 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-24 11:56:54,315 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-24 11:56:56,520 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-24 11:56:56,520 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-24 11:56:56,529 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 168) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9137 (was 9178) 2023-07-24 11:56:56,537 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=171, AvailableMemoryMB=9136 2023-07-24 11:56:56,547 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-24 11:56:56,557 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-24 11:56:56,559 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-24 11:56:56,561 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-24 11:56:56,561 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-24 11:56:56,562 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-24 11:56:56,569 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 java.lang.Thread.currentThread(Native Method) java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryAcquire(ReentrantReadWriteLock.java:392) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1198) java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.withWriteLock(BucketEntry.java:215) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1125) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 187), ProcessCount=171 (was 171), AvailableMemoryMB=9105 (was 9136) 2023-07-24 11:56:56,577 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=171, AvailableMemoryMB=9105 2023-07-24 11:56:56,586 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-07-24 11:56:56,595 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-07-24 11:56:56,596 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-07-24 11:56:56,596 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-07-24 11:56:56,599 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-07-24 11:56:56,599 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-07-24 11:56:56,608 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 187), ProcessCount=171 (was 171), AvailableMemoryMB=9071 (was 9105)