2024-01-06 23:56:27,394 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache timeout: 26 mins
2024-01-06 23:56:27,752 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78
2024-01-06 23:56:27,834 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=749, ProcessCount=188, AvailableMemoryMB=943
2024-01-06 23:56:27,878 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:27,891 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:27,906 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:27,908 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:27,912 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout
2024-01-06 23:56:30,461 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:30,462 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:30,465 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:30,465 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:30,474 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[0: blockSize=8,192, bucketSizes=null] Thread=12 (was 10)
Potentially hanging thread: Time-limited test-BucketCacheWriter-1
	java.lang.System.arraycopy(Native Method)
	java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:567)
	java.lang.StringBuffer.append(StringBuffer.java:363)
	org.apache.log4j.helpers.ISO8601DateFormat.format(ISO8601DateFormat.java:155)
	java.text.DateFormat.format(DateFormat.java:345)
	org.apache.log4j.helpers.PatternParser$DatePatternConverter.convert(PatternParser.java:411)
	org.apache.log4j.helpers.PatternConverter.format(PatternConverter.java:63)
	org.apache.log4j.PatternLayout.format(PatternLayout.java:510)
	org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:303)
	org.apache.log4j.WriterAppender.append(WriterAppender.java:156)
	org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232)
	org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57)
	org.apache.log4j.Category.callAppenders(Category.java:206)
	org.apache.log4j.Category.forcedLog(Category.java:384)
	org.apache.log4j.Category.log(Category.java:810)
	org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:980)

Potentially hanging thread: Time-limited test-BucketCacheWriter-0
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966)
 - Thread LEAK? -, OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=801 (was 749) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 188), AvailableMemoryMB=276 (was 943)
2024-01-06 23:56:30,484 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=801, ProcessCount=188, AvailableMemoryMB=275
2024-01-06 23:56:30,498 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,528 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:30,529 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:30,533 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:30,542 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=21474836480, buckets=5, bucket capacity=4294967296=(4*1073741824)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:30,543 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:30,543 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:30,543 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:30,543 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:30,554 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[0: blockSize=8,192, bucketSizes=null] Thread=11 (was 10)
Potentially hanging thread: BucketCacheStatsExecutor
 - Thread LEAK? -, OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=801 (was 801), ProcessCount=188 (was 188), AvailableMemoryMB=249 (was 275)
2024-01-06 23:56:30,570 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=801, ProcessCount=188, AvailableMemoryMB=249
2024-01-06 23:56:30,578 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,594 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:30,595 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:30,598 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:30,624 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,636 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,644 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.0, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:30,644 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:30,645 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:30,646 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,656 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,669 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:30,669 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:30,669 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:30,669 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:30,681 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=16 (was 10)
Potentially hanging thread: Time-limited test-BucketCacheWriter-0
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966)

Potentially hanging thread: Time-limited test-BucketCacheWriter-1
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966)

Potentially hanging thread: Time-limited test-BucketCacheWriter-2
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966)

Potentially hanging thread: Time-limited test-BucketCacheWriter-1
	org.apache.log4j.Category.callAppenders(Category.java:205)
	org.apache.log4j.Category.forcedLog(Category.java:384)
	org.apache.log4j.Category.log(Category.java:810)
	org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:980)

Potentially hanging thread: BucketCacheStatsExecutor
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: Time-limited test-BucketCacheWriter-0
	java.lang.Thread.currentThread(Native Method)
	org.apache.log4j.spi.LoggingEvent.getThreadName(LoggingEvent.java:391)
	org.apache.log4j.helpers.PatternParser$BasicPatternConverter.convert(PatternParser.java:367)
	org.apache.log4j.helpers.PatternConverter.format(PatternConverter.java:63)
	org.apache.log4j.PatternLayout.format(PatternLayout.java:510)
	org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:303)
	org.apache.log4j.WriterAppender.append(WriterAppender.java:156)
	org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232)
	org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57)
	org.apache.log4j.Category.callAppenders(Category.java:206)
	org.apache.log4j.Category.forcedLog(Category.java:384)
	org.apache.log4j.Category.log(Category.java:810)
	org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:980)
 - Thread LEAK? -, OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=801 (was 801), ProcessCount=188 (was 188), AvailableMemoryMB=235 (was 249)
2024-01-06 23:56:30,694 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[0: blockSize=8,192, bucketSizes=null] Thread=14, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=801, ProcessCount=188, AvailableMemoryMB=239
2024-01-06 23:56:30,701 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:30,727 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:30,728 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:30,733 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:30,885 WARN  [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2024-01-06 23:56:31,372 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering
2024-01-06 23:56:31,390 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.cache
2024-01-06 23:56:31,390 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:31,390 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:31,391 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=1, writerQLen=1, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:31,521 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.persistence
2024-01-06 23:56:31,521 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:31,789 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.cache
2024-01-06 23:56:31,790 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:31,790 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:31,933 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:31,950 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:31,973 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:31,973 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:31,973 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:31,973 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:31,983 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[0: blockSize=8,192, bucketSizes=null] Thread=19 (was 14)
Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner
	java.lang.Object.wait(Native Method)
	java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
	java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
	org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693)
	java.lang.Thread.run(Thread.java:750)
 - Thread LEAK? -, OpenFileDescriptor=291 (was 290) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=801 (was 801), ProcessCount=188 (was 188), AvailableMemoryMB=451 (was 239) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:31,992 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=801, ProcessCount=188, AvailableMemoryMB=451
2024-01-06 23:56:32,008 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:32,016 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:32,017 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:32,022 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:33,102 WARN  [Time-limited test] hfile.BlockCacheUtil(227): Cached block contents differ by nextBlockOnDiskSize, the existing block has nextBlockOnDiskSize set, Keeping cached block.
2024-01-06 23:56:34,103 WARN  [Time-limited test] hfile.BlockCacheUtil(223): Cached block contents differ by nextBlockOnDiskSize, the new block has nextBlockOnDiskSize set. Caching new block.
2024-01-06 23:56:35,204 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:35,204 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:35,206 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:35,204 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:35,217 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[0: blockSize=8,192, bucketSizes=null] Thread=19 (was 19), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=769 (was 801), ProcessCount=188 (was 188), AvailableMemoryMB=414 (was 451)
2024-01-06 23:56:35,230 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=769, ProcessCount=188, AvailableMemoryMB=413
2024-01-06 23:56:35,247 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:35,260 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:35,260 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:35,268 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:35,853 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=1073737728, buckets=511, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:35,854 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:35,854 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:35,854 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:35,857 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:35,870 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[0: blockSize=8,192, bucketSizes=null] Thread=20 (was 19) - Thread LEAK? -, OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=769 (was 769), ProcessCount=188 (was 188), AvailableMemoryMB=373 (was 413)
2024-01-06 23:56:35,882 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=769, ProcessCount=188, AvailableMemoryMB=373
2024-01-06 23:56:35,898 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:35,922 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:35,922 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:35,930 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:35,954 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:35,992 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:36,024 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.0, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:36,025 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:36,045 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:36,046 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:36,069 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.2, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:36,069 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:36,073 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:36,073 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:36,100 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 1.05, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:36,100 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:36,105 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:36,106 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:36,106 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:36,106 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:36,106 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:36,119 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=34 (was 19) - Thread LEAK? -, OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=769 (was 769), ProcessCount=188 (was 188), AvailableMemoryMB=259 (was 373)
2024-01-06 23:56:36,130 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[0: blockSize=8,192, bucketSizes=null] Thread=31, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=769, ProcessCount=188, AvailableMemoryMB=262
2024-01-06 23:56:36,145 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:36,153 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:36,153 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:36,154 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:36,168 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir so I do NOT create it in target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406
2024-01-06 23:56:36,169 WARN  [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir Erasing configuration value by system value.
2024-01-06 23:56:36,169 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir so I do NOT create it in target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406
2024-01-06 23:56:36,169 WARN  [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir Erasing configuration value by system value.
2024-01-06 23:56:36,169 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406
2024-01-06 23:56:36,170 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering
2024-01-06 23:56:36,185 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.cache
2024-01-06 23:56:36,186 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:36,186 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:36,186 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:36,187 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -240429111344473745_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,288 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.persistence
2024-01-06 23:56:37,288 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:37,288 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:37,288 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:37,306 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.cache
2024-01-06 23:56:37,306 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:37,306 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:37,309 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:37,314 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:37,314 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.persistence
2024-01-06 23:56:37,314 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:37,314 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:37,314 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:37,333 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.cache
2024-01-06 23:56:37,334 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:37,338 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:37,346 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:37,347 WARN  [Time-limited test] bucket.BucketAllocator(412): There are 1 blocks which can't be rebuilt because there is no matching bucket size for these blocks
2024-01-06 23:56:37,347 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4396d1b1-95d4-1bf6-08f8-6a43de963406/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:37,348 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:37,348 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:37,348 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:37,348 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:37,367 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 31) - Thread LEAK? -, OpenFileDescriptor=292 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=769 (was 769), ProcessCount=188 (was 188), AvailableMemoryMB=243 (was 262)
2024-01-06 23:56:37,379 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheSimple[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=769, ProcessCount=188, AvailableMemoryMB=243
2024-01-06 23:56:37,395 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:37,403 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:37,403 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:37,403 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:37,827 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,849 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.02 MB, memory=0 B
2024-01-06 23:56:37,854 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,860 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.93 MB, memory=0 B
2024-01-06 23:56:37,862 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,865 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.71 MB, memory=0 B
2024-01-06 23:56:37,868 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,871 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.49 MB, memory=0 B
2024-01-06 23:56:37,872 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,874 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.27 MB, memory=0 B
2024-01-06 23:56:37,875 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,882 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.05 MB, memory=0 B
2024-01-06 23:56:37,884 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,894 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.42 MB, memory=0 B
2024-01-06 23:56:37,895 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,897 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.20 MB, memory=0 B
2024-01-06 23:56:37,898 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,899 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1007.17 KB, memory=0 B
2024-01-06 23:56:37,927 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,929 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.38 MB, memory=0 B
2024-01-06 23:56:37,931 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,932 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.73 MB, memory=0 B
2024-01-06 23:56:37,939 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,941 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.51 MB, memory=0 B
2024-01-06 23:56:37,942 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,947 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.29 MB, memory=0 B
2024-01-06 23:56:37,954 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8453895405290093170_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,955 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3305329254923916550_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,955 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7140681825995901562_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,956 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7014102613267900042_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,956 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6269614754618926131_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,956 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3400102930163937601_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,956 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6469610373700343634_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,957 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5079375700715580024_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,957 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7444879358393925883_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,957 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2490172935047046951_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,957 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6957488753682152237_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,958 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2759437506225248562_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,958 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4561946413264787493_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,958 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8526724274240453950_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,958 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5102173269558179952_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,958 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6481654393578358044_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,959 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 525805134197037561_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,959 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2068205603277143339_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,959 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6098450722272057684_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,959 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3016702350332992741_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,959 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3558532836307887076_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,960 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3735631385008033990_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,960 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7205856665768538977_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,960 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6599856079581842939_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,960 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 86017739198796869_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,960 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5220182806249581395_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,960 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4609721515904685307_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,961 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7601454255820933933_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,961 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4727362756723160082_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,961 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6226398046901437113_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,961 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3008274296407475412_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,963 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5515620942062559528_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,963 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5972694607721236360_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,964 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8466392423211304875_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,964 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5347656363913509066_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,964 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1155258269152437696_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,965 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5985233968820542076_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,965 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5314573080083369935_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,965 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4459438816224279556_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,965 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5980828563198775510_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,965 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 778667775185809049_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,966 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1538465538117932513_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,966 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3994131803858547476_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,966 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2064478140344099663_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,966 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2563833768091136493_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,966 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8628794705959993867_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,967 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1225286624991174291_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,967 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1202282850677407166_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,967 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5086591848248537747_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,967 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4231681436601734433_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,967 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3478524255627083389_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,968 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7052760148014705688_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,968 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5311970470377869544_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,968 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9004534859009894673_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,968 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3683204597404447958_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,968 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3538097401616132236_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,969 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 460157391261790581_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,969 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8906313347315610660_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,969 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7741827856385909573_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,969 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3978387063608070114_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,970 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 699489332980951769_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,970 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6356475387785273392_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,970 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4318183615890360467_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,970 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5400100846483327132_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,970 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -885568547464183916_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,970 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1818744345169944992_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,971 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2321102726998129182_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,971 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8069480103217766918_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,971 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2287293090870832842_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,971 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3052336115826293789_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,971 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6074683659547503678_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,972 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2902424970247356532_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,972 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7586739899460883428_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,973 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8482957469129590943_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,974 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7736195286207988915_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,976 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7673189829820242936_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,976 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8276837072558590209_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,976 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4884101109883241162_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,976 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8032283589050069077_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,976 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4683472519445236267_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,977 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6746504124112086805_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,977 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6372313023046866394_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,977 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8954200933406839025_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,977 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1606310566196475488_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,977 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4948643797215594696_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,978 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5810736878987086451_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,978 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3086725019358209609_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,978 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2504671775831258027_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,978 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6532738934251392954_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,978 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4428132442882540515_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,979 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 302949571149230373_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,979 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6038619077275969376_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,979 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6742782753092465956_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,979 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8466105771449625685_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,979 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3502865435050125512_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,980 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1734221784242149127_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,980 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6772185494084365865_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,980 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2117228468091255829_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,980 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1492217739588105750_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,980 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8000974215875387728_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,980 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1966361978425032915_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,981 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8128685347839940322_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,981 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -845597176955706236_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,981 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1378803639592931436_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,981 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4730654508672376257_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,981 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7260485132533324892_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,982 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7588803962512646699_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,982 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 725445063583340915_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,982 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5672032218519323732_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,982 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5656484259721757643_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,982 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2785288785500623732_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,983 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1533668773245331610_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,983 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2582635039517725183_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,983 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4390837291812038496_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,983 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2484505012115242542_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,983 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4064324447242988982_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,984 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2082361563930129537_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,984 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2208157574926325931_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,984 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9089328981691344348_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,984 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8257781859232663988_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,984 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3802439498197901203_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,985 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8918246022848489225_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,985 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2758007913283333291_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,985 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2346165413939507780_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,985 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9045235871248844376_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,986 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1738149736307496047_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,986 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4994566025679360492_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,986 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3440124522461626883_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,986 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5356925854679684700_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,987 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5474054656465296622_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,987 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5424543062940393424_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,987 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6467401187060717518_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,987 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6453932498107667340_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,987 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2963545379716162919_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,988 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1003022648014019488_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,988 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7251198218349417180_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,988 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7698604152487108059_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,988 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,989 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=39.11 KB, total=30.06 MB, single=0 B, multi=1.68 MB, memory=0 B
2024-01-06 23:56:37,990 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,991 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.25 MB, memory=0 B
2024-01-06 23:56:37,992 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,993 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.03 MB, memory=0 B
2024-01-06 23:56:37,994 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB,  of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB
2024-01-06 23:56:37,995 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=176.01 KB, total=30.06 MB, single=0 B, multi=1.81 MB, memory=0 B
2024-01-06 23:56:37,996 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 524458162197826399_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,996 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5392983420783522667_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,996 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2340194632583908485_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,996 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -363484437509397776_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,996 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5183513779368362433_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,997 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7278744172307695703_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,997 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4255669891306574721_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,997 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1543746417874669511_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,997 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -57900279259383663_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,997 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6976898097427353585_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,997 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3027446583913614269_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,998 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8684314888978353833_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,998 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2674172997331158224_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,998 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2829096468339054224_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,998 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3922520434901946269_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,998 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5938368998470651235_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,999 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1557597270038337817_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,999 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8929011748416871448_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,999 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3559425941749203978_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,999 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6412770158583511818_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:37,999 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 720630060121392287_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,000 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1185754809792889_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,000 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2688264923122334129_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,000 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2498672831058018458_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,000 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3374047895597024854_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,000 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6470874134822279900_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,000 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -309076945665039505_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,001 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2408575459013125915_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,001 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7793547068351632629_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,001 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6299432348765169801_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,001 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5148492875413687739_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,001 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3189142617357957436_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,001 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3954555474902460275_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,002 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -526681927172003040_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,003 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9170317750590177808_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,003 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1625324277748250495_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,004 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8912239129680587609_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,008 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5453130558750436273_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,009 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1545235249269999097_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,009 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5122059267085505515_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,009 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5011056448592309564_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,009 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1453870509388389150_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,009 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3796747523511076820_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5708303193549857630_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 560068965640023885_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5153242287544272162_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5220389469074762874_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4488354912786011170_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6282750406426447471_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,010 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6603749539384887124_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8516506328853056375_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4414861830359617078_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4427543313282623224_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4627849754606967618_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 384262572876455230_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7586265734914951243_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,011 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1971401776345053112_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1971381979631650967_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6481674547558646887_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6275367366961373882_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6523416982835897918_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -601881898927624518_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3851151858015786716_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,012 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5071483889802731498_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,013 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2842519399884220720_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,013 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3118241221661639056_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,013 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4011236126454256747_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,013 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5345090671628424406_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,013 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5926950455451269166_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5713630240598083114_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5482720715815201537_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6114420441150699012_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6416646870396674759_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8029435606963766936_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -599974591933413125_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,014 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2802968229346072228_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2082618632250712035_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3007451398223933933_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -872358235679444303_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3317019273241661922_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2645806718153004557_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1327115138756843392_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,015 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6668581009888579407_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2792261326064880350_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4876174542230781174_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1970730985989767679_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5715106741786275699_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 371923452014626499_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8582597048170676483_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,016 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3428075729205005623_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,017 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3612409615921513305_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,017 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6724120760434845322_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,018 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3083741562400796605_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,018 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -491917354766039419_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,018 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -194143544606915945_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,018 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6721138526019551164_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,019 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3225881654612873455_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,019 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2403781860815492586_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,019 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1316130953832807308_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,019 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8402256878835555258_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,019 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4722952012208129097_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:38,020 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:38,020 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:38,020 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:38,029 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:38,043 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheSimple[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 769) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 188), AvailableMemoryMB=261 (was 243) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:38,059 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=188, AvailableMemoryMB=261
2024-01-06 23:56:38,077 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,109 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,109 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,132 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,133 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=true
2024-01-06 23:56:38,133 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=true
2024-01-06 23:56:38,133 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=true
2024-01-06 23:56:38,133 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:38,145 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=292 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=188 (was 188), AvailableMemoryMB=228 (was 261)
2024-01-06 23:56:38,162 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocator[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=188, AvailableMemoryMB=227
2024-01-06 23:56:38,180 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,196 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,197 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,198 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,202 DEBUG [Time-limited test] bucket.BucketAllocator(652): Bucket allocator statistics follow:
2024-01-06 23:56:38,202 DEBUG [Time-limited test] bucket.BucketAllocator(653):   Free bytes=20314112; used bytes=10413056; total bytes=30727168; wasted bytes=93184; fragmentation bytes=738304; completelyFreeBuckets=10
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 5120; used=410; free=0; total=410; wasted bytes=2048; fragmentation bytes=419840, full buckets=1
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 9216; used=228; free=0; total=228; wasted bytes=0; fragmentation bytes=233472, full buckets=1
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 17408; used=0; free=120; total=120; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 33792; used=0; free=62; total=62; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 41984; used=0; free=50; total=50; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 50176; used=0; free=41; total=41; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,203 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 58368; used=0; free=36; total=36; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 66560; used=62; free=0; total=62; wasted bytes=75776; fragmentation bytes=63488, full buckets=2
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 99328; used=21; free=0; total=21; wasted bytes=15360; fragmentation bytes=21504, full buckets=1
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 132096; used=0; free=15; total=15; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 197632; used=0; free=10; total=10; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 263168; used=0; free=7; total=7; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 394240; used=0; free=5; total=5; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,204 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 525312; used=0; free=4; total=4; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:38,212 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:38,213 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:38,217 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:38,217 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:38,241 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocator[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=188 (was 188), AvailableMemoryMB=282 (was 227) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:38,259 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=188, AvailableMemoryMB=281
2024-01-06 23:56:38,275 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,293 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,293 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,296 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,311 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,329 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,341 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,352 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.86, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,353 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,353 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,353 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,362 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:38,362 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:38,363 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:38,362 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:38,375 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=40 (was 35) - Thread LEAK? -, OpenFileDescriptor=292 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=188 (was 188), AvailableMemoryMB=275 (was 281)
2024-01-06 23:56:38,386 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[0: blockSize=8,192, bucketSizes=null] Thread=39, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=188, AvailableMemoryMB=307
2024-01-06 23:56:38,401 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,408 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,408 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,409 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,423 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,431 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.9, minFactor: 0.5, extraFreeFactor: 0.5, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2
2024-01-06 23:56:38,431 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,431 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,432 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:38,432 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:38,432 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:38,432 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:38,443 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[0: blockSize=8,192, bucketSizes=null] Thread=43 (was 39) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=188 (was 188), AvailableMemoryMB=301 (was 307)
2024-01-06 23:56:38,455 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testGetPartitionSize[0: blockSize=8,192, bucketSizes=null] Thread=43, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=188, AvailableMemoryMB=301
2024-01-06 23:56:38,469 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,474 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,474 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,475 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,489 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,495 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.5, extraFreeFactor: 0.1, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2
2024-01-06 23:56:38,496 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,496 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,496 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:38,496 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:38,496 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:38,496 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:38,515 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testGetPartitionSize[0: blockSize=8,192, bucketSizes=null] Thread=47 (was 43) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=191 (was 188) - ProcessCount LEAK? -, AvailableMemoryMB=243 (was 301)
2024-01-06 23:56:38,527 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[0: blockSize=8,192, bucketSizes=null] Thread=47, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=191, AvailableMemoryMB=242
2024-01-06 23:56:38,541 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:38,548 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,548 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,556 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,556 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir so I do NOT create it in target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c
2024-01-06 23:56:38,556 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir so I do NOT create it in target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c
2024-01-06 23:56:38,557 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering
2024-01-06 23:56:38,572 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.cache
2024-01-06 23:56:38,572 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:38,572 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:38,573 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:38,574 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1388576224922431555_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:39,676 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.persistence
2024-01-06 23:56:39,676 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:39,676 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:39,676 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:39,700 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.cache
2024-01-06 23:56:39,700 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:39,700 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:39,704 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:39,709 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8a9717dd-97fb-0ffe-4d5f-aad149c95d5c/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:39,711 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:39,711 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:39,711 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:39,711 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:39,727 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[0: blockSize=8,192, bucketSizes=null] Thread=51 (was 47) - Thread LEAK? -, OpenFileDescriptor=293 (was 292) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=189 (was 191), AvailableMemoryMB=289 (was 242) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:39,738 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testMemoryLeak[0: blockSize=8,192, bucketSizes=null] Thread=51, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=189, AvailableMemoryMB=289
2024-01-06 23:56:39,755 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:39,766 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:39,766 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:39,767 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:42,028 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:42,028 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:42,028 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:42,029 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:42,050 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testMemoryLeak[0: blockSize=8,192, bucketSizes=null] Thread=52 (was 51) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=188 (was 189), AvailableMemoryMB=257 (was 289)
2024-01-06 23:56:42,071 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=51, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=188, AvailableMemoryMB=256
2024-01-06 23:56:42,118 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,137 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:42,138 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:42,139 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:42,167 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,196 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.2, multiFactor: 0.4, memoryFactor: 0.4
2024-01-06 23:56:42,196 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:42,201 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:42,202 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,220 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,236 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,257 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:42,257 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:42,257 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:42,258 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:42,267 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=58 (was 51)
Potentially hanging thread: pool-79-thread-2
 - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=203 (was 188) - ProcessCount LEAK? -, AvailableMemoryMB=255 (was 256)
2024-01-06 23:56:42,275 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRAMCache[0: blockSize=8,192, bucketSizes=null] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=203, AvailableMemoryMB=255
2024-01-06 23:56:42,284 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,291 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:42,292 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:42,299 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:42,300 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:42,300 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:42,302 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:42,302 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:42,314 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRAMCache[0: blockSize=8,192, bucketSizes=null] Thread=65 (was 55)
Potentially hanging thread: pool-81-thread-3
	java.lang.Thread.isInterrupted(Native Method)
	java.lang.Thread.isInterrupted(Thread.java:969)
	java.util.concurrent.ThreadPoolExecutor.interruptIdleWorkers(ThreadPoolExecutor.java:794)
	java.util.concurrent.ThreadPoolExecutor.tryTerminate(ThreadPoolExecutor.java:704)
	java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1014)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-81-thread-6
	sun.misc.Unsafe.unpark(Native Method)
	java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.unparkSuccessor(AbstractQueuedSynchronizer.java:662)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1264)
	java.util.concurrent.locks.ReentrantLock.unlock(ReentrantLock.java:457)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:449)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-81-thread-7
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
	java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
	java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
	java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1006)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-81-thread-4
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
	java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
	java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
	java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1006)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-81-thread-8
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-81-thread-1
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-81-thread-2
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)
 - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=203 (was 203), AvailableMemoryMB=262 (was 255) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:42,323 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[0: blockSize=8,192, bucketSizes=null] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=203, AvailableMemoryMB=262
2024-01-06 23:56:42,337 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,345 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:42,345 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:42,349 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:42,350 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:42,350 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:42,350 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:42,350 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:42,362 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[0: blockSize=8,192, bucketSizes=null] Thread=56 (was 55) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=811 (was 811), ProcessCount=203 (was 203), AvailableMemoryMB=235 (was 262)
2024-01-06 23:56:42,371 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=811, ProcessCount=203, AvailableMemoryMB=235
2024-01-06 23:56:42,387 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:42,400 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:42,400 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:42,401 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,041 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:43,042 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:43,042 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:43,041 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:43,058 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=56 (was 55) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 811) - SystemLoadAverage LEAK? -, ProcessCount=203 (was 203), AvailableMemoryMB=642 (was 235) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:43,066 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=203, AvailableMemoryMB=642
2024-01-06 23:56:43,076 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,083 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,083 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,084 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,087 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=21474836480, buckets=5, bucket capacity=4294967296=(4*1073741824)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,088 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:43,088 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:43,088 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:43,088 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:43,099 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=57 (was 55) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 1011), ProcessCount=203 (was 203), AvailableMemoryMB=636 (was 642)
2024-01-06 23:56:43,112 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=203, AvailableMemoryMB=636
2024-01-06 23:56:43,124 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,136 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,136 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,138 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,153 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,174 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,213 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.0, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,213 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,218 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,218 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,240 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,257 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:43,257 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:43,258 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:43,257 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:43,275 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=60 (was 55)
Potentially hanging thread: pool-97-thread-7
	java.lang.Throwable.fillInStackTrace(Native Method)
	java.lang.Throwable.fillInStackTrace(Throwable.java:784)
	java.lang.Throwable.<init>(Throwable.java:251)
	java.lang.Exception.<init>(Exception.java:54)
	java.lang.InterruptedException.<init>(InterruptedException.java:57)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)
 - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 1011), ProcessCount=203 (was 203), AvailableMemoryMB=589 (was 636)
2024-01-06 23:56:43,288 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=59, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=203, AvailableMemoryMB=589
2024-01-06 23:56:43,309 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,324 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,324 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,329 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,330 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir so I do NOT create it in target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c
2024-01-06 23:56:43,330 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir so I do NOT create it in target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c
2024-01-06 23:56:43,331 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering
2024-01-06 23:56:43,345 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.cache
2024-01-06 23:56:43,345 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,345 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,353 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=1, writerQLen=1, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,462 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.persistence
2024-01-06 23:56:43,462 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:43,485 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.cache
2024-01-06 23:56:43,485 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,486 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,492 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,495 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f922ae21-09a5-0253-4ca2-053f7b99fb7c/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:43,496 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:43,497 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:43,497 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:43,497 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:43,519 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=67 (was 59) - Thread LEAK? -, OpenFileDescriptor=294 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 1011), ProcessCount=203 (was 203), AvailableMemoryMB=582 (was 589)
2024-01-06 23:56:43,533 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=63, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=203, AvailableMemoryMB=583
2024-01-06 23:56:43,549 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:43,559 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:43,560 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:43,564 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:44,665 WARN  [Time-limited test] hfile.BlockCacheUtil(227): Cached block contents differ by nextBlockOnDiskSize, the existing block has nextBlockOnDiskSize set, Keeping cached block.
2024-01-06 23:56:45,766 WARN  [Time-limited test] hfile.BlockCacheUtil(223): Cached block contents differ by nextBlockOnDiskSize, the new block has nextBlockOnDiskSize set. Caching new block.
2024-01-06 23:56:46,866 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:46,867 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:46,868 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:46,868 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:46,879 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=65 (was 63) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 1011), ProcessCount=186 (was 203), AvailableMemoryMB=2570 (was 583) - AvailableMemoryMB LEAK? -
2024-01-06 23:56:46,892 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=63, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=186, AvailableMemoryMB=2570
2024-01-06 23:56:46,908 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:46,916 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:46,917 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:46,920 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:46,921 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=1073737728, buckets=511, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:46,921 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:46,925 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:46,926 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:46,929 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:46,939 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=67 (was 63) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 1011), ProcessCount=186 (was 186), AvailableMemoryMB=2541 (was 2570)
2024-01-06 23:56:46,955 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=63, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=186, AvailableMemoryMB=2539
2024-01-06 23:56:46,971 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:46,984 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:46,984 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:46,985 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:47,000 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:47,019 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:47,040 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.0, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:47,041 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:47,041 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:47,042 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:47,065 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.2, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:47,065 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:47,069 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:47,070 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:47,103 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 1.05, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:47,104 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:47,113 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:47,114 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:47,114 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:47,114 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:47,114 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:47,129 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79 (was 63)
Potentially hanging thread: pool-115-thread-8
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-115-thread-6
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.unlinkCancelledWaiters(AbstractQueuedSynchronizer.java:1908)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2046)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-115-thread-7
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)

Potentially hanging thread: pool-115-thread-5
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	java.lang.Thread.run(Thread.java:750)
 - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 1011), ProcessCount=186 (was 186), AvailableMemoryMB=2399 (was 2539)
2024-01-06 23:56:47,142 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=75, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=1011, ProcessCount=186, AvailableMemoryMB=2399
2024-01-06 23:56:47,157 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:47,169 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:47,170 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:47,177 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:47,198 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir so I do NOT create it in target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5
2024-01-06 23:56:47,198 WARN  [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir Erasing configuration value by system value.
2024-01-06 23:56:47,199 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir so I do NOT create it in target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5
2024-01-06 23:56:47,199 WARN  [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir Erasing configuration value by system value.
2024-01-06 23:56:47,199 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5
2024-01-06 23:56:47,200 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering
2024-01-06 23:56:47,218 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.cache
2024-01-06 23:56:47,218 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:47,219 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:47,226 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:47,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8207597687486566012_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,327 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.persistence
2024-01-06 23:56:48,327 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:48,327 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:48,327 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:48,344 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.cache
2024-01-06 23:56:48,344 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:48,344 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,347 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,347 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:48,348 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.persistence
2024-01-06 23:56:48,348 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:48,348 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:48,348 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:48,364 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.cache
2024-01-06 23:56:48,365 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:48,366 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,370 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,370 WARN  [Time-limited test] bucket.BucketAllocator(412): There are 1 blocks which can't be rebuilt because there is no matching bucket size for these blocks
2024-01-06 23:56:48,371 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/23b551cd-01fe-9dc2-e6fe-27f057997ee5/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:48,372 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:48,372 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:48,372 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:48,372 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:48,383 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79 (was 75) - Thread LEAK? -, OpenFileDescriptor=295 (was 294) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 1011), ProcessCount=186 (was 186), AvailableMemoryMB=2339 (was 2399)
2024-01-06 23:56:48,397 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheSimple[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2338
2024-01-06 23:56:48,411 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:48,416 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:48,417 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,417 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:48,782 ERROR [Time-limited test-BucketCacheWriter-1] util.ResourceLeakDetector(337): LEAK: RefCnt.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
Recent access records: 
#1:
	org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120)
	org.apache.hadoop.hbase.nio.RefCnt.release(RefCnt.java:83)
	org.apache.hadoop.hbase.nio.ByteBuff.release(ByteBuff.java:87)
	org.apache.hadoop.hbase.io.hfile.HFileBlock.release(HFileBlock.java:420)
	org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:237)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:459)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:444)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:418)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:407)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133)
	org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	org.junit.runners.Suite.runChild(Suite.java:128)
	org.junit.runners.Suite.runChild(Suite.java:27)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
#2:
	org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120)
	org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71)
	org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414)
	org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37)
	org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410)
	org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:541)
	org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:216)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:459)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:444)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:418)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:407)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133)
	org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	org.junit.runners.Suite.runChild(Suite.java:128)
	org.junit.runners.Suite.runChild(Suite.java:27)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
#3:
	org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120)
	org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71)
	org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414)
	org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37)
	org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410)
	org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:541)
	org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:150)
	org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	org.junit.runners.Suite.runChild(Suite.java:128)
	org.junit.runners.Suite.runChild(Suite.java:27)
	org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
Created at:
	org.apache.hadoop.hbase.nio.RefCnt.<init>(RefCnt.java:59)
	org.apache.hadoop.hbase.nio.RefCnt.create(RefCnt.java:54)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.<init>(BucketEntry.java:110)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1499)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059)
	org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:972)
2024-01-06 23:56:48,819 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -773963754083135428_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6416771848132444533_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1985689343615665036_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2534599778430398014_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1581630274923578100_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8327292643061768268_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2909928060875204423_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,820 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2192203472548321307_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1581671147019757140_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8025327743280751635_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -997817388699954361_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2912138695305259740_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1007156586807288359_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5982193588147432755_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3168945099196774858_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,821 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -54158918424686039_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2317543734711208119_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2267732369285171803_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3832458959608711919_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3879796220935100630_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3933457308909726534_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1166987248257795391_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3888916976744931100_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2547460223259436777_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,822 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6017148139629512989_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3510753420152015696_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8202251107418052049_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5901191824557016385_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1461462954686941168_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2000021498954965898_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4480651982147989331_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 154606575060805042_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,823 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7861121881556139704_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3986877154601496151_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5724212835842591222_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8135653921473907738_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6344773596480162196_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -33841206721554257_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7831158903051204659_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1343849535628530505_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,824 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3336642934106412501_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2862449807308156339_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4399357109100894746_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6438323555324881140_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1165145163255264268_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2248947471841861207_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8911616615365495824_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -234393727873299315_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,825 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4859903434374040184_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -880478514720594420_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1131034112196554056_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 887118021796346832_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4119753397993538082_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7336786507454368929_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6311465633844095522_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8297174896259399408_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9026558981058305811_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,826 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6367801330463728964_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8226100240706540952_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3295613720042633033_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -445624190192562849_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 783684846951017518_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5785452156415233468_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 436807786972000994_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6737494763931772362_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5884311667383471888_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,827 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 358225065613659580_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 223286242163948036_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 153283924169888591_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2355367013679140821_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4658552434939109761_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4454352772223364628_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6314326756586046850_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7196627995320868232_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4645156236470456281_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,828 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -464747652650974374_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2132991738721465926_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3079460714478176790_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8198766133444621800_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1002229727892868483_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1926791228523621977_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5473292440402133290_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,829 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3849886812765923287_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7788425392171320863_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -437586138412372040_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4146424240967109824_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4782159533952342707_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9208240218260733720_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1988275161548282486_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 850405853493649871_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8397412139835025282_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,830 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1075847582169851992_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8699292363668601086_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7208576223851640768_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2055611149078900528_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5841919228515088549_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5029810799121948836_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -64346572719678400_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5629130062842752168_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9022278252526764647_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7814293197199958711_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,831 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7310428410086056581_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1010775935679615004_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4973104885593511064_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5604283067291903611_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8575803617895033857_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8309717478959406274_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8770850724827975967_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2794670900471662936_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4839572522353805777_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,832 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3142797162878490639_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1978890305883677297_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2895347007257094775_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3796634529704407339_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5217984577267349438_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8761001502266071727_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5874822501703951592_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2823318336228957988_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2195879708655850156_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,833 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8230523261009058231_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -334685009698531455_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8421795577449071660_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2776276796419131555_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2164689924441271035_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -732306639399716981_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2664538043011578003_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8690052226616243091_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1646682993038910041_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8337535597462482277_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,834 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8039040217021625841_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 63425494126306855_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7580291581169325518_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3027572916761534631_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8271825527684707178_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5144204289230542191_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2932946965259191707_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4673471787237255154_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4415096951662896202_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7607048773972083837_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,835 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6361630418798569793_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 516423562045005914_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -498171323770723279_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4855402563736879436_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8956842248979124443_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3881929821527814978_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1009974755482497553_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8929435270217855008_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,836 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3076266122265198946_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3635697578264394556_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6942718410665756955_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2991740279840687829_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7816227578140311790_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -403083817468012294_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1529146082198052974_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 916234393974477226_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4997083040764807414_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3941295115328317408_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,837 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2364103925722810655_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3367789120328506852_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2860160974020581281_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2027669059278531463_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5947824415098377947_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2521138181235311271_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1569847629548779580_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2863566477717974152_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4392785178057920683_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,838 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6262604752202678230_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7584204252278188962_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2461213253437062709_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 926615903628959797_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8728907137968078119_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4778997405625226379_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7286832987880491148_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6976611761678153880_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3134325644431210953_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9102218224741478213_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,839 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5083810330822775333_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5008244458253623308_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4912762606632003253_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3771965836597288434_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8245585916731649982_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7367133932224178532_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8574778233154632092_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6639919838682231786_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8244313649092619223_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7064584182037806697_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,840 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9170714865126468943_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7433800503830140278_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8432921600829073026_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3376998768178475457_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5306104200795914295_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2185936556164319189_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7123410930693493203_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3253310200253033893_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2098904661430987627_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,841 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5356493124320169397_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,842 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 987078205647904983_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,842 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4882858268323552789_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,842 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4322646899593157371_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,842 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2466769872534513166_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,842 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1345037782852696999_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4677932236219157393_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4624986760623400188_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5224213330453166531_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1391615433739205720_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -310794548088672012_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7260653814120391795_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5992967085919877431_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3696792690239238512_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,843 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 270701157552495846_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5817278352740577554_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9180006532621831633_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1239035769873583589_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3570166775114748457_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2496148653274264789_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4097538801485686444_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -861466083376400276_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3995155223461273745_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,844 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2337834206942677509_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2681951366455291665_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4124769539610807924_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4477071834026939593_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6124434818831284114_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2722174990691568382_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2270030521933690691_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7697843649454802213_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7941262790659340089_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1006276801629317531_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,845 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5667025662841422810_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9141682963731320981_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 610324083705717798_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1907491675170089090_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5602095582173260913_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4700221149842745107_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5420215283505113316_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,846 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8719316921705148935_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,847 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3236906650655463293_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,847 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3515379222754622169_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,847 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1005057452500090771_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,847 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7960912982757991027_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7225796385059792683_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5084322303545587331_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7974444195827756876_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5093866174659433984_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1080588127426814915_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1438330672655437742_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6512563192619261559_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1711666294823672226_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5563322753174246069_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,848 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5135443440493870311_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3823903520234784676_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2374250343301909134_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1447149118333148598_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6063557436733489662_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8514409479278597082_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5578640310934072793_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3359388553074363189_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4965000914469008023_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3465519078541248428_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,849 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8257017326311626822_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2968550469147762349_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4012501094570435153_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7826526680456070951_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8970330756561165352_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3917797542529500720_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3646197415015854397_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8277879560682278624_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5719797071291644633_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1111418136917772235_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,850 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6731492962022680028_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 771609540572689522_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4185186826916836103_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1131837233253748000_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1715196210053677587_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3824121322885231869_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 795632922339004796_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3350974966016295322_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5677688535312207911_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -264714034652298925_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,851 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6968729822998862182_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3634713372134694331_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 965408855967055672_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 25886678040946626_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -448817805100183275_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -611459133384772986_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6022021000827839533_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6131764271763744970_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2581622485557129549_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3026710174209991711_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,852 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5494210434451423049_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3114093900777968315_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2408048913903384360_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6014717948276309657_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5315099184958079745_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2150200526034722480_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3514382034443251825_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2100776718184777866_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1961036092139367859_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5756340431079368065_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,853 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4310366176192539664_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2691414357384243829_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3665728176807808490_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4411194781018478073_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1484049158034994256_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2487562116241495200_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6734143568580912120_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7893177068991680171_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,854 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8689934569517139562_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2902617223423091225_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8595872851499592511_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1891488475541737821_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5197143910068983976_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1069755017060202146_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4604795882600036883_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5320779935442426990_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5179468786583890627_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1537807680500552992_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,855 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9169304611257446385_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7557675230982262579_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7603982420892199750_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7562841529426854590_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1804540518513467866_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5210806197643520206_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5322593202552410819_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8605855517999090924_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1028631558953362271_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9040083710038789025_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,856 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9106447110232979911_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 601289393649750279_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 186359888794065778_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2681497993529198753_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 346905453420359749_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5369414856321612511_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2894227264431405802_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7872012013917207311_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2946346879471403349_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4495869895344049232_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,857 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4234703686251829436_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6392471808739843423_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4300005970420115187_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2637165644063557536_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8983066802062211722_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7688877719909540365_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4589251302390707510_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4125849430007376314_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7677653190101211436_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3165420799825523489_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,858 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -494287944037113649_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6095054414035363397_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7428982978047773305_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7248592009462603961_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4634569445677746274_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4039589381450293382_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1444583730651529794_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6872784574106157982_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4298034582073205676_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6400823496582558889_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,859 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4158541968882825118_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6283439429532244401_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2017631923255869209_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6299542436037162905_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7350448329206091101_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3520936506445321908_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1757392871133006290_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4364368377649773532_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,860 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4842623961787234894_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:48,862 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:48,862 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:48,862 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:48,862 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:48,880 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheSimple[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79 (was 79), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=2306 (was 2338)
2024-01-06 23:56:48,892 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2306
2024-01-06 23:56:48,906 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:48,913 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:48,913 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,914 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:48,914 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=true
2024-01-06 23:56:48,914 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=true
2024-01-06 23:56:48,914 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=true
2024-01-06 23:56:48,914 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:48,925 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79 (was 79), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=2279 (was 2306)
2024-01-06 23:56:48,936 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocator[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2279
2024-01-06 23:56:48,949 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:48,956 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:48,956 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:48,961 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:48,962 DEBUG [Time-limited test] bucket.BucketAllocator(652): Bucket allocator statistics follow:
2024-01-06 23:56:48,962 DEBUG [Time-limited test] bucket.BucketAllocator(653):   Free bytes=2590720; used bytes=28397568; total bytes=30988288; wasted bytes=2248704; fragmentation bytes=749568; completelyFreeBuckets=5
2024-01-06 23:56:48,962 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 3072; used=0; free=172; total=172; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:48,962 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 5120; used=206; free=0; total=206; wasted bytes=2048; fragmentation bytes=210944, full buckets=2
2024-01-06 23:56:48,962 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 9216; used=228; free=0; total=228; wasted bytes=12288; fragmentation bytes=233472, full buckets=4
2024-01-06 23:56:48,963 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 17408; used=0; free=30; total=30; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:48,963 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 29696; used=0; free=17; total=17; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:48,963 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 33792; used=0; free=15; total=15; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:48,963 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 66560; used=133; free=0; total=133; wasted bytes=1186816; fragmentation bytes=136192, full buckets=19
2024-01-06 23:56:48,963 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 99328; used=165; free=0; total=165; wasted bytes=1047552; fragmentation bytes=168960, full buckets=33
2024-01-06 23:56:48,963 DEBUG [Time-limited test] bucket.BucketAllocator(659):   Object size 132096; used=0; free=4; total=4; wasted bytes=0; fragmentation bytes=0, full buckets=0
2024-01-06 23:56:48,964 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:48,964 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:48,964 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:48,964 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:48,972 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocator[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=80 (was 79) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=2248 (was 2279)
2024-01-06 23:56:48,983 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2247
2024-01-06 23:56:48,996 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,001 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:49,001 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,001 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,014 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,019 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,027 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,032 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.86, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:49,032 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,033 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,033 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,040 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:49,040 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:49,040 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:49,040 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:49,051 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=83 (was 79) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=2131 (was 2247)
2024-01-06 23:56:49,061 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=83, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2131
2024-01-06 23:56:49,070 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,076 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:49,076 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,077 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,090 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,095 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.9, minFactor: 0.5, extraFreeFactor: 0.5, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2
2024-01-06 23:56:49,095 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,096 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,096 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:49,096 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:49,096 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:49,096 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:49,104 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=87 (was 83) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=2073 (was 2131)
2024-01-06 23:56:49,113 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testGetPartitionSize[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=87, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2073
2024-01-06 23:56:49,126 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,131 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:49,131 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,134 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,144 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,151 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.5, extraFreeFactor: 0.1, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2
2024-01-06 23:56:49,152 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,152 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,152 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:49,153 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:49,153 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:49,156 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:49,165 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testGetPartitionSize[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=92 (was 87) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=2024 (was 2073)
2024-01-06 23:56:49,178 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=91, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=2023
2024-01-06 23:56:49,187 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:49,197 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:49,198 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,205 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,206 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-log-dir so I do NOT create it in target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5
2024-01-06 23:56:49,206 INFO  [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/92475e67-be7b-6c95-a425-0951ed9d3b78/hadoop-tmp-dir so I do NOT create it in target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5
2024-01-06 23:56:49,206 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering
2024-01-06 23:56:49,215 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.cache
2024-01-06 23:56:49,215 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:49,215 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:49,217 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:49,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5406174059747346497_0. This is harmless and can happen in rare cases (see HBASE-8547)
2024-01-06 23:56:50,318 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.persistence
2024-01-06 23:56:50,318 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:50,318 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:50,318 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:50,334 INFO  [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.cache
2024-01-06 23:56:50,334 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:50,335 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:50,338 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:50,341 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a3c00a9d-5718-9bbd-b269-eafc400784f5/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:50,341 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:50,341 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:50,342 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:50,342 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:50,353 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=98 (was 91) - Thread LEAK? -, OpenFileDescriptor=296 (was 295) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=1964 (was 2023)
2024-01-06 23:56:50,364 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testMemoryLeak[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=95, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=1963
2024-01-06 23:56:50,379 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:50,386 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:50,386 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:50,386 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:52,638 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:52,638 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:52,638 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:52,638 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:52,650 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testMemoryLeak[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=95 (was 95), OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=1878 (was 1963)
2024-01-06 23:56:52,662 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=95, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=1878
2024-01-06 23:56:52,677 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,694 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:52,695 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:52,697 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:52,711 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,743 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.2, multiFactor: 0.4, memoryFactor: 0.4
2024-01-06 23:56:52,743 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:52,757 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:52,758 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,792 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,804 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,815 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:52,815 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:52,816 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:52,816 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:52,830 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=99 (was 95) - Thread LEAK? -, OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=1754 (was 1878)
2024-01-06 23:56:52,841 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRAMCache[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=99, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=1754
2024-01-06 23:56:52,855 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,861 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:52,861 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:52,861 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:52,862 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:52,862 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:52,862 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:52,862 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:52,874 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRAMCache[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=101 (was 99) - Thread LEAK? -, OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=1722 (was 1754)
2024-01-06 23:56:52,886 INFO  [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=99, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=961, ProcessCount=186, AvailableMemoryMB=1722
2024-01-06 23:56:52,900 INFO  [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16
2024-01-06 23:56:52,905 INFO  [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25
2024-01-06 23:56:52,905 INFO  [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size))
2024-01-06 23:56:52,906 INFO  [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator
2024-01-06 23:56:52,906 INFO  [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false
2024-01-06 23:56:52,906 INFO  [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false
2024-01-06 23:56:52,906 INFO  [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false
2024-01-06 23:56:52,906 INFO  [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null
2024-01-06 23:56:52,917 INFO  [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[1: blockSize=16,384, bucketSizes=[I@460d0a57] Thread=99 (was 99), OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=961 (was 961), ProcessCount=186 (was 186), AvailableMemoryMB=1698 (was 1722)