2023-07-18 03:56:36,551 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCacheRefCnt timeout: 13 mins
2023-07-18 03:56:36,731 DEBUG [main] util.ClassSize(228): Using Unsafe to estimate memory layout
2023-07-18 03:56:36,766 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=188, ProcessCount=172, AvailableMemoryMB=7121
2023-07-18 03:56:36,801 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 03:56:36,818 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 03:56:36,833 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 03:56:36,836 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 03:56:38,024 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 03:56:38,026 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 03:56:38,035 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testMarkStaleAsEvicted Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 188), ProcessCount=172 (was 172), AvailableMemoryMB=7069 (was 7121)
2023-07-18 03:56:38,043 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=172, AvailableMemoryMB=7069
2023-07-18 03:56:38,058 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 03:56:38,076 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 03:56:38,077 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 03:56:38,078 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 03:56:39,179 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 03:56:39,179 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 03:56:39,187 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testBlockInBackingMap Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 173), ProcessCount=172 (was 172), AvailableMemoryMB=7054 (was 7069)
2023-07-18 03:56:39,199 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=172, AvailableMemoryMB=7053
2023-07-18 03:56:39,214 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 03:56:39,229 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 03:56:39,230 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 03:56:39,234 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 03:56:41,439 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 03:56:41,440 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 03:56:41,448 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testReplacingBlockAndGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 173), ProcessCount=172 (was 172), AvailableMemoryMB=7410 (was 7053) - AvailableMemoryMB LEAK? -
2023-07-18 03:56:41,456 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=172, AvailableMemoryMB=7409
2023-07-18 03:56:41,466 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 03:56:41,480 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 03:56:41,482 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 03:56:41,485 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 03:56:41,486 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 03:56:41,487 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 03:56:41,497 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testInBucketCache Thread=11 (was 10)
Potentially hanging thread: Time-limited test-BucketCacheWriter-0
	sun.misc.Unsafe.compareAndSwapLong(Native Method)
	java.util.concurrent.atomic.AtomicLong.compareAndSet(AtomicLong.java:147)
	org.apache.hadoop.hbase.util.AtomicUtils.updateMin(AtomicUtils.java:42)
	org.apache.hadoop.hbase.metrics.impl.FastLongHistogram$Bins.add(FastLongHistogram.java:125)
	org.apache.hadoop.hbase.metrics.impl.FastLongHistogram.add(FastLongHistogram.java:275)
	org.apache.hadoop.hbase.io.hfile.CacheStats.evicted(CacheStats.java:245)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.blockEvicted(BucketCache.java:577)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.lambda$doDrain$7(BucketCache.java:1127)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$$Lambda$46/1747277768.handle(Unknown Source)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.withWriteLock(BucketEntry.java:216)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1125)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973)
 - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 173), ProcessCount=172 (was 172), AvailableMemoryMB=7367 (was 7409)
2023-07-18 03:56:41,506 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=172, AvailableMemoryMB=7366
2023-07-18 03:56:41,519 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2023-07-18 03:56:41,539 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2023-07-18 03:56:41,540 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33554432, buckets=1024, bucket capacity=32768=(4*8192)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2023-07-18 03:56:41,543 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=1 KB, writerThreadNum=1, writerQLen=1000, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2023-07-18 03:56:41,553 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2023-07-18 03:56:41,553 INFO  [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null
2023-07-18 03:56:41,567 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCacheRefCnt#testEvictingBlockCachingBlockGettingBlockConcurrently Thread=10 (was 10), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 173), ProcessCount=172 (was 172), AvailableMemoryMB=7322 (was 7366)