2023-07-19 17:56:26,311 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins
2023-07-19 17:56:26,524 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout
2023-07-19 17:56:26,562 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=171, AvailableMemoryMB=7313
2023-07-19 17:56:26,605 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-19 17:56:26,621 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-19 17:56:26,640 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-19 17:56:26,643 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-19 17:56:27,846 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-19 17:56:27,848 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-19 17:56:27,860 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=7192 (was 7313)
2023-07-19 17:56:27,870 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=171, AvailableMemoryMB=7191
2023-07-19 17:56:27,890 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-19 17:56:27,910 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-19 17:56:27,912 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-19 17:56:27,913 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-19 17:56:29,014 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-19 17:56:29,014 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-19 17:56:29,023 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 192), ProcessCount=171 (was 171), AvailableMemoryMB=7113 (was 7191)
2023-07-19 17:56:29,032 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=171, AvailableMemoryMB=7113
2023-07-19 17:56:29,046 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-19 17:56:29,057 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-19 17:56:29,058 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-19 17:56:29,058 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-19 17:56:31,263 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-19 17:56:31,264 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-19 17:56:31,272 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 192), ProcessCount=171 (was 171), AvailableMemoryMB=7047 (was 7113)
2023-07-19 17:56:31,280 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=171, AvailableMemoryMB=7046
2023-07-19 17:56:31,291 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-19 17:56:31,299 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-19 17:56:31,301 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-19 17:56:31,305 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-19 17:56:31,305 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-19 17:56:31,306 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-19 17:56:31,314 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10)
Potentially hanging thread: Time-limited test-BucketCacheWriter-0
	sun.misc.Unsafe.compareAndSwapObject(Native Method)
	java.util.concurrent.ConcurrentSkipListMap$Index.casRight(ConcurrentSkipListMap.java:583)
	java.util.concurrent.ConcurrentSkipListMap$Index.unlink(ConcurrentSkipListMap.java:616)
	java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:677)
	java.util.concurrent.ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:987)
	java.util.concurrent.ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1992)
	java.util.concurrent.ConcurrentSkipListSet.remove(ConcurrentSkipListSet.java:259)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.blockEvicted(BucketCache.java:573)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.lambda$doDrain$7(BucketCache.java:1127)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$$Lambda$46/819170783.handle(Unknown Source)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.withWriteLock(BucketEntry.java:216)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1125)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973)
 - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 192), ProcessCount=171 (was 171), AvailableMemoryMB=7013 (was 7046)
2023-07-19 17:56:31,322 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=171, AvailableMemoryMB=7013
2023-07-19 17:56:31,332 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-19 17:56:31,340 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-19 17:56:31,342 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-19 17:56:31,342 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-19 17:56:31,345 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-19 17:56:31,346 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-19 17:56:31,355 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 192), ProcessCount=171 (was 171), AvailableMemoryMB=6980 (was 7013)