2024-01-21 23:55:09,725 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache timeout: 26 mins 2024-01-21 23:55:09,964 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb 2024-01-21 23:55:10,021 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=167, AvailableMemoryMB=18437 2024-01-21 23:55:10,054 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:10,066 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:10,077 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:10,079 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:10,082 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-21 23:55:11,397 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:11,397 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:11,397 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:11,398 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:11,409 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[0: blockSize=8,192, bucketSizes=null] Thread=10 (was 10), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=17778 (was 18437) 2024-01-21 23:55:11,417 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=167, AvailableMemoryMB=17778 2024-01-21 23:55:11,428 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,437 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:11,437 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:11,440 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:11,448 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=21474836480, buckets=5, bucket capacity=4294967296=(4*1073741824)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:11,448 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:11,448 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:11,448 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:11,448 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:11,457 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[0: blockSize=8,192, bucketSizes=null] Thread=11 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 sun.nio.cs.UTF_8$Encoder.encodeBufferLoop(UTF_8.java:646) sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:693) java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:579) org.apache.maven.surefire.api.stream.AbstractStreamEncoder.encodeString(AbstractStreamEncoder.java:118) org.apache.maven.surefire.api.stream.AbstractStreamEncoder.encodeStringData(AbstractStreamEncoder.java:156) org.apache.maven.surefire.api.stream.AbstractStreamEncoder.encode(AbstractStreamEncoder.java:145) org.apache.maven.surefire.booter.spi.EventChannelEncoder.encodeMessage(EventChannelEncoder.java:378) org.apache.maven.surefire.booter.spi.EventChannelEncoder.setOutErr(EventChannelEncoder.java:172) org.apache.maven.surefire.booter.spi.EventChannelEncoder.testOutput(EventChannelEncoder.java:168) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:99) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:43) org.apache.maven.surefire.common.junit4.JUnit4RunListener.writeTestOutput(JUnit4RunListener.java:202) org.apache.maven.surefire.api.report.ConsoleOutputCapture$ForwardingPrintStream.write(ConsoleOutputCapture.java:57) sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291) sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295) sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141) java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229) org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:54) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:317) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:980) - Thread LEAK? -, OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 365), ProcessCount=167 (was 167), AvailableMemoryMB=17747 (was 17778) 2024-01-21 23:55:11,465 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=167, AvailableMemoryMB=17747 2024-01-21 23:55:11,473 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,480 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:11,481 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:11,482 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:11,501 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,508 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,522 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.0, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:11,522 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:11,523 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:11,523 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,532 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,539 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:11,539 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:11,539 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:11,539 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:11,547 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=15 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966) Potentially hanging thread: BucketCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-BucketCacheWriter-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 sun.nio.cs.StreamEncoder.write(StreamEncoder.java:133) java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) java.io.Writer.write(Writer.java:157) org.apache.log4j.helpers.QuietWriter.write(QuietWriter.java:45) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:303) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:980) - Thread LEAK? -, OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 365), ProcessCount=167 (was 167), AvailableMemoryMB=17588 (was 17747) 2024-01-21 23:55:11,556 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[0: blockSize=8,192, bucketSizes=null] Thread=14, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=167, AvailableMemoryMB=17588 2024-01-21 23:55:11,562 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:11,569 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:11,570 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:11,571 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:11,657 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-21 23:55:11,971 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-21 23:55:11,985 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.cache 2024-01-21 23:55:11,985 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:11,985 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:11,987 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=1, writerQLen=1, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:12,142 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.persistence 2024-01-21 23:55:12,142 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:12,295 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.cache 2024-01-21 23:55:12,295 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:12,295 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:12,358 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:12,360 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:12,376 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:12,376 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:12,376 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:12,376 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:12,385 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[0: blockSize=8,192, bucketSizes=null] Thread=20 (was 14) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=291 (was 290) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 365), ProcessCount=167 (was 167), AvailableMemoryMB=17719 (was 17588) - AvailableMemoryMB LEAK? - 2024-01-21 23:55:12,393 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=167, AvailableMemoryMB=17718 2024-01-21 23:55:12,411 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:12,418 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:12,418 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:12,420 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:13,477 WARN [Time-limited test] hfile.BlockCacheUtil(227): Cached block contents differ by nextBlockOnDiskSize, the existing block has nextBlockOnDiskSize set, Keeping cached block. 2024-01-21 23:55:14,578 WARN [Time-limited test] hfile.BlockCacheUtil(223): Cached block contents differ by nextBlockOnDiskSize, the new block has nextBlockOnDiskSize set. Caching new block. 2024-01-21 23:55:15,679 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:15,679 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:15,679 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:15,679 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:15,688 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[0: blockSize=8,192, bucketSizes=null] Thread=19 (was 19), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 365), ProcessCount=167 (was 167), AvailableMemoryMB=17988 (was 17718) - AvailableMemoryMB LEAK? - 2024-01-21 23:55:15,696 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=167, AvailableMemoryMB=17987 2024-01-21 23:55:15,708 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:15,715 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:15,716 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:15,717 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,214 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=1073737728, buckets=511, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,215 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:16,215 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:16,215 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:16,215 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:16,224 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[0: blockSize=8,192, bucketSizes=null] Thread=19 (was 19), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 365) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=17897 (was 17987) 2024-01-21 23:55:16,233 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17897 2024-01-21 23:55:16,250 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:16,260 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:16,261 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,264 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,275 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:16,285 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:16,299 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.0, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:16,299 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,301 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,307 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:16,330 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.2, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:16,331 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,337 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,338 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:16,347 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 1.05, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:16,348 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,348 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,349 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:16,349 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:16,349 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:16,349 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:16,358 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=31 (was 19) - Thread LEAK? -, OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17734 (was 17897) 2024-01-21 23:55:16,366 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[0: blockSize=8,192, bucketSizes=null] Thread=31, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17731 2024-01-21 23:55:16,379 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:16,392 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:16,392 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,396 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,407 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir so I do NOT create it in target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d 2024-01-21 23:55:16,407 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir Erasing configuration value by system value. 2024-01-21 23:55:16,407 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir so I do NOT create it in target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d 2024-01-21 23:55:16,408 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir Erasing configuration value by system value. 2024-01-21 23:55:16,408 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d 2024-01-21 23:55:16,408 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-21 23:55:16,421 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.cache 2024-01-21 23:55:16,421 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:16,421 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:16,424 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:16,425 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -528063717011178847_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:17,526 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:17,526 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.persistence 2024-01-21 23:55:17,526 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:17,526 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:17,546 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.cache 2024-01-21 23:55:17,547 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:17,547 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:17,550 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:17,550 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:17,551 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.persistence 2024-01-21 23:55:17,551 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:17,551 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:17,551 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:17,569 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.cache 2024-01-21 23:55:17,569 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:17,572 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:17,581 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:17,581 WARN [Time-limited test] bucket.BucketAllocator(412): There are 1 blocks which can't be rebuilt because there is no matching bucket size for these blocks 2024-01-21 23:55:17,587 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3a9d9763-5fa4-803e-56bc-50792b56e40d/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:17,588 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:17,588 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:17,588 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:17,588 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:17,602 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 31) - Thread LEAK? -, OpenFileDescriptor=292 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17985 (was 17731) - AvailableMemoryMB LEAK? - 2024-01-21 23:55:17,610 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheSimple[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17985 2024-01-21 23:55:17,622 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:17,633 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:17,633 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:17,635 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:17,998 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,015 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.17 MB, memory=0 B 2024-01-21 23:55:18,016 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,018 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.95 MB, memory=0 B 2024-01-21 23:55:18,019 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,021 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.73 MB, memory=0 B 2024-01-21 23:55:18,022 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,024 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.12 MB, memory=0 B 2024-01-21 23:55:18,025 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,026 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.90 MB, memory=0 B 2024-01-21 23:55:18,027 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,029 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.68 MB, memory=0 B 2024-01-21 23:55:18,039 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,041 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.07 MB, memory=0 B 2024-01-21 23:55:18,042 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,043 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.85 MB, memory=0 B 2024-01-21 23:55:18,044 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,046 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.24 MB, memory=0 B 2024-01-21 23:55:18,046 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,047 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.02 MB, memory=0 B 2024-01-21 23:55:18,048 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,049 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(927): Bucket cache free space completed; freed=185.79 KB, total=30.06 MB, single=0 B, multi=1.80 MB, memory=0 B 2024-01-21 23:55:18,057 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1976520744561128281_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,058 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2440686216661854710_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,058 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9083140715681785780_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,058 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 132239194146288560_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,058 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3796697179655938116_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,059 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8137632649317786568_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,059 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8785858124607110773_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,059 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5973646672069454032_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,059 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7510538345331555489_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,060 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2340276816578776880_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,060 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6580838458955200966_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,060 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 299697405518597185_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,060 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6725255225332520957_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,060 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1448923185411771272_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,061 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4659623001465648903_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,061 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2887839279689199330_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,061 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8448316435448953926_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,061 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7381324317523658419_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,062 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8933365568329347634_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,062 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8133891008470765778_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,062 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6980940440563949807_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,062 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7224584283979967434_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,062 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3584520128428159241_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,063 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6068794420661454623_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,063 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -554673169292649839_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,063 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7515396971239691257_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,063 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8695024100895379871_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,063 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2320081594123209214_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,064 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7376405569227710982_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,064 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2861159282097948080_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,064 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4211199514402614312_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,064 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7315381137391753539_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,065 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1698319483858427457_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,065 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -743257392820463234_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,065 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9058191437140886952_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,065 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5926399314310302242_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,065 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3483221911551954983_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,066 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5519341342577342353_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,066 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -706499604524422404_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,066 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1000980918048336225_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,066 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6328333018547961818_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,066 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6743353325125891023_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,067 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7009748229444589957_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,067 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 617703940929524191_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,067 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1004227530089415074_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,067 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6678197891098678589_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,067 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2060018321151363245_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,068 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5324003533204030810_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,068 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5283628756895273735_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,068 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1017664131637754988_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,068 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1709211688081637671_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,069 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2494770934516357003_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,069 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6114887577220659299_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,069 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3096253929718408750_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,069 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3285170959950865558_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,069 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7287225720511587911_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,069 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8205915525639226376_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3532711426796311418_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5611333704598121607_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3060054073503438980_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1428047057165098385_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4946556421676738229_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3098715702109883810_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 635393732154709795_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,070 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9134353628398594179_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5116742224789045168_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3143362309362774467_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6360317867592135116_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5684050158696162704_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3159624780834250663_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4357536931650430749_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,071 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7742967397327883619_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,072 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8253695281492484039_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,072 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 123360889960350423_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,072 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 425111513552489407_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,072 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5104042374387420903_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,072 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4946779516807960301_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,073 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3464379965226283049_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,073 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1619992632173224883_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,073 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7440742196771866541_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,073 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5768367591878246610_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,073 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6100940322848925042_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,074 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5855529746092966812_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,074 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7032278207020512620_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,074 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3858175414168851887_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,074 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5666359316698131502_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,074 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6005509706917321528_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,075 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1378852831231794529_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,075 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1837023341657476453_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,075 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7825401405207486416_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,075 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8645055675053477125_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,075 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8984521982010967563_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,075 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6996315196979633503_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,076 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7401009765959590520_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,076 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6895871670603961045_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,076 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2353303705937739054_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,076 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3118564046084388935_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,076 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -210647116031306410_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,076 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6354174470773449713_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -697527907732392089_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7476066486964244555_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 740240918967403151_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3888948889149413139_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -336335377384189800_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2916501505956844991_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4683957522219490693_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5151135436341365041_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -816653630300027239_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,077 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -61095329969291764_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,078 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3281895675917999080_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,078 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5156505811783357206_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,078 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -618757748046886948_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,078 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2471717042221032357_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,078 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 634497840997153755_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,078 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7494952424688692605_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,079 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1185040148860075061_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,079 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 328428359701037411_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,079 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 560146762007347383_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,079 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4031179206473675545_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,079 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4490812959997810825_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,079 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2226740281936616410_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,080 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 544980336555263684_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,080 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6090853324057417363_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,080 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8572086290974873615_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,080 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4951023227146533905_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,080 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7869672612174947352_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,080 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7946483833423613043_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,081 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2333985870332315984_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,081 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3916259189699889947_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,081 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3183238140849266517_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,081 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4765121841300119428_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,081 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9132390410778138971_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,081 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1467943721626347521_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9097331493433698589_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4916728559358982076_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5835952447656220784_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2207899547166578033_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7690310234359778750_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8512927794852808004_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,082 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -444479077202740917_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8361112199159419791_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5091146140434104940_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 622121902955480047_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 441794422990436829_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2128876846697863939_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2592436753102795929_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,083 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3408580670553653057_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1596470161496230999_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3602483973860986601_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1497764454673850862_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5579116437741936228_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2177376563828509256_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5435804214811109762_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,084 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6544548218847754427_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6525852884340923952_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3657576767073501731_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1198560821504938598_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1335352981273487383_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3245144448716158921_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6054573092392708185_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,085 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7605630217189194165_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6276117156609567398_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7022449712780776334_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8387401120977537120_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6494942467045946403_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2619500626773514198_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2534825556111146350_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7734299180479402055_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,086 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2002649336192389267_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7707221671158519674_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8919275941620624592_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 355437474686711720_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7941092591519706497_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -774606449121070637_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3528754069289347015_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,087 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5202982075367847374_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7496216895879707788_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7255052757953492948_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7274864679032276801_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2675737839752363752_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4060613696183687767_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7071541607897459550_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,088 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7928565416893837358_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6717293986551155089_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4235184023142303003_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8887106896840875264_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6350913966242133952_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5565466226587534149_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1917664351910845443_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,089 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8454586534131719208_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,090 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3247178858519536441_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,090 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,090 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6465332259958275188_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,090 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4692201594621397607_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,090 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1414663711785116064_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,090 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3988634818154318335_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,090 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5138814875290408984_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,091 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1234359787318120438_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,091 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.23 MB, memory=0 B 2024-01-21 23:55:18,091 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5883651537662826205_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,091 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3367411650503094890_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,091 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5383182733551814923_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,091 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9062132688996503134_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,091 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,091 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1576691063283975607_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,092 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5983202462903949230_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,092 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6385923302445702336_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,092 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1647038957189683197_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,092 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7081522050468363508_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,092 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.01 MB, memory=0 B 2024-01-21 23:55:18,092 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8138965123589376443_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,093 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7017957684575140759_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,093 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,093 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6748516987079852028_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,093 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6128585864170201465_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,093 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2069169955709108658_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,093 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2657492693331230960_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,093 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=19.56 KB, total=30.06 MB, single=0 B, multi=1.80 MB, memory=0 B 2024-01-21 23:55:18,093 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6592702801574403679_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2902498105237120866_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1315041864280534872_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 424810546365808867_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3861132283641928410_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4324944934241005860_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3552713332123715755_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,094 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2915395015585995474_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8225037175690939410_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2962352283845280684_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8302579868880736509_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1016866103427601290_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7836837438414843105_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6334641344024700511_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,095 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8210396017350290090_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,096 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2607677706346736018_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,096 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5207522432537120774_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,096 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5302182514452315710_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,096 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8937973584396113763_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,096 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6889800677326533836_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,096 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8035978652234790909_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,097 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 271657390358606854_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,097 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5843495204810002060_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5993346456861236327_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -890355400987217411_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7743517909000587561_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6840171731468943926_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,098 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2642113057938865988_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3901954878680274518_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,098 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5468994440269960081_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5130057842015644521_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1050036914638158750_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3787804637807544299_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9046450854339709477_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7891826271054575805_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,099 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,099 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8750331859669467033_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,100 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5787376549028759814_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,100 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,100 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5557713817303733525_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,100 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2079865593625929725_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,100 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7240060858836131239_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,100 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6310919684303427926_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,100 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5722804889926098601_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7384823967193307402_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2525194738914602393_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8903496281669670199_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1666831436654211979_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7544367313893865052_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8022790990083843030_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,101 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2488444455650047756_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,102 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4486773413026219369_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,102 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4070528238519521921_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,102 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 491729103264884863_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,102 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,102 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6834212057740172800_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,102 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8623972821067452025_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,102 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,102 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1071309559933071271_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,103 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4393407519467301410_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,103 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2302384341271453358_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,103 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -588884640726134542_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,103 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,103 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8135112611249678997_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,103 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 135872693192279054_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,103 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,103 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3214232233703931893_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1751155025223997640_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7532681891528728027_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5383654896011091805_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6475862305604239750_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -184603821028022637_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8152083964069014125_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8098966427894243982_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3716963915770221202_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -558511773472768605_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3239707543133144529_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,104 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 756588882537789212_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2163546882994520160_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8064240443859370362_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1965061105543108266_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8127429592754674920_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4745226254703077045_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5839475384380686316_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4155163270005976346_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4694580730333899632_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1145503084863513502_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6433341187495564065_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,105 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2284766179691884803_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -613047102713875219_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2813236249143294071_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3712107672923350621_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8080810933237346157_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7467258175386647132_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7238658724611836311_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,106 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,106 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5919961931902719500_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7348721430916127849_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3973805096597517511_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5386207546726201609_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5892207736996114387_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7674815812799938281_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9019743054960010452_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,107 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2493677570890491748_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,108 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,108 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 910072123425576144_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,108 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4245655207158742711_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,108 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,108 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8404235556758320534_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,108 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4660103706373281422_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,109 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5591077425115726503_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:18,109 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,109 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,110 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,110 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,111 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,111 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,112 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,112 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(842): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-01-21 23:55:18,112 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:18,112 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:18,121 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:18,121 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(927): Bucket cache free space completed; freed=0 B, total=30.06 MB, single=0 B, multi=1.78 MB, memory=0 B 2024-01-21 23:55:18,123 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:18,130 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheSimple[0: blockSize=8,192, bucketSizes=null] Thread=36 (was 35) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17884 (was 17985) 2024-01-21 23:55:18,137 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17883 2024-01-21 23:55:18,149 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,157 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,157 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,157 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,158 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=true 2024-01-21 23:55:18,158 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=true 2024-01-21 23:55:18,158 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=true 2024-01-21 23:55:18,158 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:18,166 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17845 (was 17883) 2024-01-21 23:55:18,173 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocator[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17844 2024-01-21 23:55:18,184 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,193 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,194 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,194 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,197 DEBUG [Time-limited test] bucket.BucketAllocator(652): Bucket allocator statistics follow: 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(653): Free bytes=20314112; used bytes=10435584; total bytes=30749696; wasted bytes=70656; fragmentation bytes=728064; completelyFreeBuckets=10 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 5120; used=410; free=0; total=410; wasted bytes=2048; fragmentation bytes=419840, full buckets=1 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 9216; used=228; free=0; total=228; wasted bytes=0; fragmentation bytes=233472, full buckets=1 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 17408; used=0; free=120; total=120; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 33792; used=0; free=62; total=62; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 41984; used=0; free=50; total=50; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 50176; used=0; free=41; total=41; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 58368; used=0; free=36; total=36; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 66560; used=31; free=0; total=31; wasted bytes=37888; fragmentation bytes=31744, full buckets=1 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 99328; used=42; free=0; total=42; wasted bytes=30720; fragmentation bytes=43008, full buckets=2 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 132096; used=0; free=15; total=15; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 197632; used=0; free=10; total=10; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 263168; used=0; free=7; total=7; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 394240; used=0; free=5; total=5; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,198 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 525312; used=0; free=4; total=4; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:18,200 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:18,200 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:18,200 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:18,200 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:18,209 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocator[0: blockSize=8,192, bucketSizes=null] Thread=37 (was 35) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17804 (was 17844) 2024-01-21 23:55:18,217 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17802 2024-01-21 23:55:18,233 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,242 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,242 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,242 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,253 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,260 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,279 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,295 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.86, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,295 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,296 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,296 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,316 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:18,316 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:18,316 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:18,316 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:18,326 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=39 (was 35) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17627 (was 17802) 2024-01-21 23:55:18,334 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[0: blockSize=8,192, bucketSizes=null] Thread=39, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17626 2024-01-21 23:55:18,346 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,359 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,359 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,360 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,372 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,380 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.9, minFactor: 0.5, extraFreeFactor: 0.5, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-01-21 23:55:18,380 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,384 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,385 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:18,385 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:18,385 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:18,385 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:18,396 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[0: blockSize=8,192, bucketSizes=null] Thread=43 (was 39) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17548 (was 17626) 2024-01-21 23:55:18,407 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testGetPartitionSize[0: blockSize=8,192, bucketSizes=null] Thread=43, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17545 2024-01-21 23:55:18,418 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,424 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,425 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,427 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,438 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,447 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.5, extraFreeFactor: 0.1, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-01-21 23:55:18,447 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,448 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,448 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:18,448 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:18,448 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:18,448 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:18,459 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testGetPartitionSize[0: blockSize=8,192, bucketSizes=null] Thread=47 (was 43) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17484 (was 17545) 2024-01-21 23:55:18,469 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[0: blockSize=8,192, bucketSizes=null] Thread=47, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17482 2024-01-21 23:55:18,480 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:18,487 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,487 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,488 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,489 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir so I do NOT create it in target/test-data/4f1d651e-5055-1203-4702-510fea6d843e 2024-01-21 23:55:18,489 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir so I do NOT create it in target/test-data/4f1d651e-5055-1203-4702-510fea6d843e 2024-01-21 23:55:18,489 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-21 23:55:18,499 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.cache 2024-01-21 23:55:18,499 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:18,500 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:18,500 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:18,500 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1584364303255232998_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:19,601 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.persistence 2024-01-21 23:55:19,601 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:19,601 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:19,601 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:19,614 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.cache 2024-01-21 23:55:19,614 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:19,614 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:19,617 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:19,617 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f1d651e-5055-1203-4702-510fea6d843e/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:19,618 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:19,618 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:19,618 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:19,618 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:19,626 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[0: blockSize=8,192, bucketSizes=null] Thread=51 (was 47) - Thread LEAK? -, OpenFileDescriptor=293 (was 292) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17313 (was 17482) 2024-01-21 23:55:19,633 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testMemoryLeak[0: blockSize=8,192, bucketSizes=null] Thread=51, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=167, AvailableMemoryMB=17313 2024-01-21 23:55:19,644 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:19,651 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:19,651 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:19,652 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:21,905 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:21,905 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:21,905 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:21,905 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:21,913 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testMemoryLeak[0: blockSize=8,192, bucketSizes=null] Thread=52 (was 51) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 400), ProcessCount=167 (was 167), AvailableMemoryMB=17043 (was 17313) 2024-01-21 23:55:21,921 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=51, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=17042 2024-01-21 23:55:21,933 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:21,940 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:21,940 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:21,940 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:21,959 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:21,969 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.2, multiFactor: 0.4, memoryFactor: 0.4 2024-01-21 23:55:21,969 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:21,969 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:21,970 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:21,979 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:21,987 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:21,995 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:21,995 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:21,995 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:21,995 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:22,006 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=59 (was 51) Potentially hanging thread: pool-79-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-79-thread-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-79-thread-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-79-thread-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16884 (was 17042) 2024-01-21 23:55:22,015 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRAMCache[0: blockSize=8,192, bucketSizes=null] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16883 2024-01-21 23:55:22,025 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:22,031 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:22,032 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:22,032 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:22,032 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:22,033 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:22,032 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:22,033 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:22,042 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRAMCache[0: blockSize=8,192, bucketSizes=null] Thread=55 (was 55), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16851 (was 16883) 2024-01-21 23:55:22,050 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[0: blockSize=8,192, bucketSizes=null] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16851 2024-01-21 23:55:22,060 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:22,067 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:22,067 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:22,068 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:22,068 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:22,068 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:22,068 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:22,068 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:22,077 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[0: blockSize=8,192, bucketSizes=null] Thread=55 (was 55), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16819 (was 16851) 2024-01-21 23:55:22,085 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16818 2024-01-21 23:55:22,096 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:22,103 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:22,103 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:22,104 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,553 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:24,553 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:24,553 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:24,553 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:24,562 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=55 (was 55), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16788 (was 16818) 2024-01-21 23:55:24,569 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16787 2024-01-21 23:55:24,579 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,583 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,583 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,584 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,588 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=21474836480, buckets=5, bucket capacity=4294967296=(4*1073741824)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,588 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:24,588 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:24,588 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:24,588 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:24,597 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=55 (was 55), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16784 (was 16787) 2024-01-21 23:55:24,606 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=55, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16784 2024-01-21 23:55:24,617 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,620 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,621 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,622 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,632 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,637 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,643 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.0, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,643 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,643 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,644 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,650 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,658 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:24,658 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:24,658 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:24,658 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:24,666 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=59 (was 55) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16760 (was 16784) 2024-01-21 23:55:24,673 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=59, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16760 2024-01-21 23:55:24,683 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,688 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,688 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,688 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,689 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir so I do NOT create it in target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03 2024-01-21 23:55:24,689 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir so I do NOT create it in target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03 2024-01-21 23:55:24,689 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-21 23:55:24,699 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.cache 2024-01-21 23:55:24,699 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,699 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,699 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=1, writerQLen=1, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,849 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.persistence 2024-01-21 23:55:24,849 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:24,862 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.cache 2024-01-21 23:55:24,862 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,862 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,865 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,865 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/86b57b93-1239-ad59-f0dd-d919f05afa03/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:24,866 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:24,866 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:24,866 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:24,866 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:24,874 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=63 (was 59) - Thread LEAK? -, OpenFileDescriptor=294 (was 293) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16745 (was 16760) 2024-01-21 23:55:24,882 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=63, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=167, AvailableMemoryMB=16745 2024-01-21 23:55:24,894 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:24,898 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:24,898 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:24,899 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:26,000 WARN [Time-limited test] hfile.BlockCacheUtil(227): Cached block contents differ by nextBlockOnDiskSize, the existing block has nextBlockOnDiskSize set, Keeping cached block. 2024-01-21 23:55:27,101 WARN [Time-limited test] hfile.BlockCacheUtil(223): Cached block contents differ by nextBlockOnDiskSize, the new block has nextBlockOnDiskSize set. Caching new block. 2024-01-21 23:55:28,202 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:28,202 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:28,202 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:28,202 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:28,212 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=64 (was 63) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 392), ProcessCount=167 (was 167), AvailableMemoryMB=16681 (was 16745) 2024-01-21 23:55:28,221 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=63, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16681 2024-01-21 23:55:28,236 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,241 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,241 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,245 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,246 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=1073737728, buckets=511, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,246 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:28,246 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:28,246 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:28,246 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:28,256 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=63 (was 63), OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16668 (was 16681) 2024-01-21 23:55:28,264 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=63, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16668 2024-01-21 23:55:28,274 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,277 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,278 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,278 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,288 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,292 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,299 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.0, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,299 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,300 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,300 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,304 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.2, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,304 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,305 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,305 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,308 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 1.05, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,308 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,308 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,308 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:28,308 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:28,308 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:28,308 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:28,317 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=75 (was 63) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16580 (was 16668) 2024-01-21 23:55:28,324 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=75, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16579 2024-01-21 23:55:28,334 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:28,338 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,338 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,338 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,348 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir so I do NOT create it in target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76 2024-01-21 23:55:28,348 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir Erasing configuration value by system value. 2024-01-21 23:55:28,348 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir so I do NOT create it in target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76 2024-01-21 23:55:28,349 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir Erasing configuration value by system value. 2024-01-21 23:55:28,349 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76 2024-01-21 23:55:28,349 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-21 23:55:28,358 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.cache 2024-01-21 23:55:28,359 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:28,359 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:28,359 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:28,359 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7361025040902798838_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,460 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.persistence 2024-01-21 23:55:29,460 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:29,460 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:29,460 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:29,473 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.cache 2024-01-21 23:55:29,473 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:29,473 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,476 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,476 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:29,476 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.persistence 2024-01-21 23:55:29,476 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:29,476 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:29,476 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:29,489 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.cache 2024-01-21 23:55:29,489 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:29,489 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,492 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,492 WARN [Time-limited test] bucket.BucketAllocator(412): There are 1 blocks which can't be rebuilt because there is no matching bucket size for these blocks 2024-01-21 23:55:29,492 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b51ec925-cb3b-ac0c-a3c9-cd5dfde33f76/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:29,493 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:29,493 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:29,493 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:29,493 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:29,501 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79 (was 75) - Thread LEAK? -, OpenFileDescriptor=295 (was 294) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16562 (was 16579) 2024-01-21 23:55:29,508 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheSimple[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16562 2024-01-21 23:55:29,519 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:29,523 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:29,523 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,524 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:29,845 ERROR [Time-limited test-BucketCacheWriter-1] util.ResourceLeakDetector(337): LEAK: RefCnt.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information. Recent access records: #1: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.release(RefCnt.java:83) org.apache.hadoop.hbase.nio.ByteBuff.release(ByteBuff.java:87) org.apache.hadoop.hbase.io.hfile.HFileBlock.release(HFileBlock.java:420) org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:237) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:459) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:444) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:418) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:407) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #2: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:541) org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:216) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:459) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:444) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:418) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:407) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #3: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:541) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:150) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #4: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:541) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:140) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Created at: org.apache.hadoop.hbase.nio.RefCnt.(RefCnt.java:59) org.apache.hadoop.hbase.nio.RefCnt.create(RefCnt.java:54) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.(BucketEntry.java:110) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1499) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:972) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7524145400886108980_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7260018363433317902_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3177049018513239997_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 135310955293063097_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3853250587709199681_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8713444669284231560_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1608190750508206239_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 218539685126418658_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8197783763203058647_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,884 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -144992338646031969_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6787197136467408549_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2581078689833629992_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4685620233529803165_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2478540833474137678_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5991890363983512737_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4268018702377473606_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8642644371038256687_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3245735792685582537_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1992826050173641912_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8613206453932844354_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3958743680635067052_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3491399150178461184_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7242250660750863752_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7134207106957045670_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9140845876128085922_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,885 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8569903490244449805_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7607053665687801515_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3475894632272659754_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 454692903550818537_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 943611196552538399_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3445215356122461832_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1697457230811838013_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6588744135347854546_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 531473277902205463_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6597229531601431056_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1214562492874804330_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8154978321938552962_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -69797381802915979_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6782713412949974122_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7214499703976457426_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8596975990508628105_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,886 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 269811547095946989_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8010733170933615607_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5957423545223423978_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5268189936722703903_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5852373975801807328_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2252677198564537884_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5672360944265706147_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2834745513334070002_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4782414222551526972_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4510737410915135751_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6034418683430440057_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4155629999621116742_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9148896921401641035_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8773915395555234862_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9144266300028422301_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,887 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8083813156853842144_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7488786485829927890_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8549185868270765869_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 776077766789408385_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7556358528325984232_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -429848371865275339_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7642928543700950139_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 397596239874840037_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6261542746749028183_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6534834737837003853_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4459286373426049627_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8502049761406956411_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7296129680979358854_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1823295125445816195_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3026520392308480901_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2875935575584145994_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,888 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2124230499918529738_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2430021593358791102_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7253838810777187628_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8704416332282076087_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7592849843552508272_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3726095135453788358_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7572246054460482883_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7098556257574601688_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6728683432996242698_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8110922766707607255_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8458098957184149679_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6576370705771757794_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1668784114593142158_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6819628360835179957_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5093638363964030315_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5265664272678663541_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4932820935044364568_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,889 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -672343587914092607_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6685426150831468328_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6917741950701771790_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1409733008127024584_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5727299978876684561_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4490336806928746198_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2233506718410565575_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6010553384586593981_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4651760903775804636_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4221052501533716932_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6447797065669020401_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -890071501461605113_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1058291287664172977_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1242413979791386830_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5228212957335150780_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2603869691769979813_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,890 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9173271651885132249_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7608040591331734387_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7320385287397574467_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7230348962475317644_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8920028680018801155_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7153509185805750889_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7064337984932132231_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1853398090026542262_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5396484848374222204_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7843838371408703793_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7133470360050981336_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6924086776709502756_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5526775319218968789_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7702643752869629631_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4692707787980281373_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5649042252810442990_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8536882226977470941_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,891 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8876437237584730563_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2860707516755123688_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8851072910404805349_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7146011123163371558_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2340059559419526945_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4135169758922032632_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5323331198771383496_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -971065625106789044_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6399063384117045092_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4637784670222778543_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8692934148675522753_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1486886638063004248_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4391729296015856530_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7037688459105844863_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8006413035654904939_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1982994239826231973_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3833676832818595433_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,892 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -435136897864838781_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8274336551392471673_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3681828181906662015_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6481641658114677847_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1141513589649317378_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3402221087345698938_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8338942196582789502_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1373710467018953956_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8719356737731549489_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5810417855063086286_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6920396548912084003_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -905586639041813141_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6707984388844841937_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7947890450315428956_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4263303531706014342_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4012697306004731677_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1211736151977466789_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,893 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3947514409662375661_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6386875121393454499_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5876376956224301241_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2466107778644973390_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7909708236676502659_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2038021425689521419_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8955259186120930964_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8729644179767428748_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 394222872198441008_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1689899938514415200_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3275769323800840753_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1261125032911302964_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7439777921339802400_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -908449856962412666_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1236734344629301457_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4049067840420987672_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,894 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7083240367751296400_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1638522109706968712_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3424967155078355131_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2658276354904845336_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5991788889607546971_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3019023357131013443_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8041329233362634872_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8611204577301737583_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5344716112306817870_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3641263888345201110_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2992060205569430722_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4057281762338897068_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3786895255431737052_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2953114771201158505_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1940447506132880685_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3582422157082935017_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6220476791804570256_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,895 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5346698325166751315_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3747705406651776488_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -672473292254499106_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9198902329645817744_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5826012990437115591_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3936760546362356674_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3058167149878197119_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -511233663720021694_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1580873023051070475_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4003283636807164105_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3928173637532085331_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3565947844909891668_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5904849205747221806_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5320511138623539843_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2263603228112865990_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4243357871364031007_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,896 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6184863875738364202_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1180440763256158851_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5692688529537023826_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5109410446319552398_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -723867149555814961_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2451511638373424827_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3871866664304128814_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 490276790388033100_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1778111838838239280_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8228197087330828103_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6266899056557031021_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2294524614273135539_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -172604923016181451_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6085042869135554217_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1720877762619179517_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1715925405351064015_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2611347766550524871_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,897 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4949626851835130191_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4041574429856169215_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8932170781893105278_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3688773218698410946_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2429502834761578139_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6346934859318147172_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2518339502954898876_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4922343217211537551_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4609248859285007318_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3191696150888779831_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2416554058113371603_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5626345419600802308_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8452207599037437535_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8093855448396154312_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7346186176177305590_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8695728310101902983_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,898 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1860285531990161723_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5836298862187956308_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8215226925161853955_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -354848045095189425_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6821870595561302972_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8328990024962489993_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7763779999998699504_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1460484093416107844_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6671394630592534004_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4070233815623855005_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,899 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6479966968786232248_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2996369778369573961_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3301785273680213110_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5522566066131941696_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6131007309638622173_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6887234917950691124_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2787998881718725073_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2499960544458363243_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6002088793117945164_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 913993354722245944_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3980089961954862387_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7945095528689521425_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7672696178300723521_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7955537856397010252_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9192496305921640137_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2430691159910986535_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1617053839680810344_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1880152463875473804_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,900 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7224108472548982745_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2804625176150030806_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7536558972807717548_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8011824752565968_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6323752110550811982_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5363292154120209788_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8145539893912278309_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 578436769079145253_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8823387884502411090_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7251580227186202520_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8006114543905691141_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2016898387421387823_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4546921523341298566_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7038504346145064714_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6086027470753374853_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5658131163443714175_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6696288924839099128_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,901 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3983999738366661345_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1047417778962177739_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1294002925804193254_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2749547763854439564_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1603067695616508346_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -677327747268627079_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7005124752943866983_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6832866279249337879_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2531814699787482197_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5134866241250937861_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9196055794675862812_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3381385427761243176_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4844753204626913489_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3209897610080022035_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1141575932171879007_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 758804432764520535_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7273176697715716090_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1482755552973362830_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,902 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3453899548918184730_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7205199102952043085_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3333989150823998472_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4641015361634025949_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7821009986961374051_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4334891218590811379_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3719272770093191909_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1970914376761382926_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4854554598708105041_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7220177450235703409_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7946637850029032071_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5130255044571000400_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5646434684137547347_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1157413761208892743_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4410008755440888432_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7654925092551845114_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3950751707806739370_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,903 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3880293543616750133_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -23590675171205598_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6919380475545086574_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4112825893712884305_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8676017044642333895_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7220742042842190093_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8099870191815606468_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5834008673684170013_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6008994595996994533_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7002612063424436583_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1418552101773797322_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2744649886765669676_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6029911524126379975_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7085985013294702089_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7416724148785266593_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -691168744619353407_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4432419300732088529_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1791791943497673599_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,904 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8592310098709531012_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7928647511623654458_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1309776494610969608_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5571701562376452743_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7274145866942704414_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7804465677293424945_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1972764057184072354_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6476810165084407998_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1675025412567674062_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1511662627940419227_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3593409150857948723_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8742260803611687710_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -325587192328395807_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1731839390474067482_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 725666641119942024_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6121996166085634491_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4911723836286209432_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,905 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5082286670504615288_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5317236399727752972_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4754717122330491830_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8778553138886066341_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6414665978941107616_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3416245373781232818_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5613519190532165157_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5928315684830896637_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1728117989573185623_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3047182673923760748_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8812351294273187875_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8690449534676872280_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8244229676462249826_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5119031299718736784_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7267255680827569683_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4429973093810269315_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6938918922733121987_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4128152232289406234_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7158439120588028869_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,906 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4390164502318527079_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4706387162085163692_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8407766374331875695_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6290373431234042474_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8621480651420783219_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3290859091886777984_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7105197557683711176_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -54131021358422957_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3337820954516080433_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9091608414815087573_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8835036797893065735_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2406965283330684111_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3441344771429779056_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3379987283827299929_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4679216123044065676_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3551943714866882117_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7368331864733881975_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,907 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -726966592835356578_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4394267044199577310_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2383009538406898948_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1253726275749580962_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7857607215762134867_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8637901732802910410_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6369011666148369122_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8379454150334089378_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6459023332077464809_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8239407626905683682_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8246541968630962684_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1337632977467089934_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3011223813970583257_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6376893173289312658_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6646296710584182342_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4029273440718273496_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,908 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1788701146068488969_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1305336190752684761_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6230658209920305521_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3883648621998676687_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2931382221089044644_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3967238217868876928_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8035018177711231074_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9210259061415453027_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1054773323539601861_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5569831658583003019_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6990474449529099492_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5762484943967260107_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5054202388427300458_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4218962561518553333_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5739587072172845441_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7091289020992330566_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7505126217363121357_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7276905930288273165_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7146224269934895415_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,909 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4194708217426281537_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6408945921545260000_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7464488238753009208_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3702723424951442225_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5463437026514412851_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5293618008644994171_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9021729601165722151_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7346019459876944818_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 531316297014662401_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -673430558779221441_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2980664631710589129_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8343257562399716642_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4951543148467793561_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4961493758969754553_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2493155172117409158_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4723600208190715498_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2205392430740674686_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1026013619408463837_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,910 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2773490246225246213_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,911 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4177947133957353303_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,911 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8505657686579448335_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,911 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6692389141295813153_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:29,914 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:29,914 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:29,914 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:29,914 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:29,925 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheSimple[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79 (was 79), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16528 (was 16562) 2024-01-21 23:55:29,935 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16527 2024-01-21 23:55:29,946 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:29,953 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:29,953 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,953 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:29,953 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=true 2024-01-21 23:55:29,953 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=true 2024-01-21 23:55:29,954 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=true 2024-01-21 23:55:29,954 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:29,962 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79 (was 79), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16500 (was 16527) 2024-01-21 23:55:29,970 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocator[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16500 2024-01-21 23:55:29,982 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:29,987 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:29,987 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:29,988 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:29,989 DEBUG [Time-limited test] bucket.BucketAllocator(652): Bucket allocator statistics follow: 2024-01-21 23:55:29,989 DEBUG [Time-limited test] bucket.BucketAllocator(653): Free bytes=2590720; used bytes=28307456; total bytes=30898176; wasted bytes=2338816; fragmentation bytes=700416; completelyFreeBuckets=5 2024-01-21 23:55:29,989 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 3072; used=0; free=172; total=172; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:29,989 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 5120; used=206; free=0; total=206; wasted bytes=2048; fragmentation bytes=210944, full buckets=2 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 9216; used=171; free=0; total=171; wasted bytes=9216; fragmentation bytes=175104, full buckets=3 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 17408; used=0; free=30; total=30; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 29696; used=0; free=17; total=17; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 33792; used=0; free=15; total=15; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 66560; used=147; free=0; total=147; wasted bytes=1311744; fragmentation bytes=150528, full buckets=21 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 99328; used=160; free=0; total=160; wasted bytes=1015808; fragmentation bytes=163840, full buckets=32 2024-01-21 23:55:29,990 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 132096; used=0; free=4; total=4; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-01-21 23:55:29,991 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:29,991 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:29,991 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:29,991 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:29,999 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocator[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79 (was 79), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16471 (was 16500) 2024-01-21 23:55:30,006 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=79, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16471 2024-01-21 23:55:30,016 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,021 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:30,021 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,022 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,031 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,035 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,042 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,050 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.86, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:30,051 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,051 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,051 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,058 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:30,058 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:30,058 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:30,058 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:30,066 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=83 (was 79) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16367 (was 16471) 2024-01-21 23:55:30,074 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=83, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16367 2024-01-21 23:55:30,085 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,090 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:30,090 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,090 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,100 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,106 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.9, minFactor: 0.5, extraFreeFactor: 0.5, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-01-21 23:55:30,107 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,107 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,107 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:30,107 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:30,107 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:30,107 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:30,115 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=87 (was 83) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16306 (was 16367) 2024-01-21 23:55:30,123 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testGetPartitionSize[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=87, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16306 2024-01-21 23:55:30,133 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,140 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:30,140 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,141 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,153 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,160 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.5, extraFreeFactor: 0.1, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-01-21 23:55:30,161 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,161 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,161 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:30,161 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:30,161 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:30,161 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:30,172 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testGetPartitionSize[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=91 (was 87) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16261 (was 16306) 2024-01-21 23:55:30,181 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=91, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=167, AvailableMemoryMB=16261 2024-01-21 23:55:30,192 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:30,198 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:30,198 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,199 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,200 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-log-dir so I do NOT create it in target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41 2024-01-21 23:55:30,200 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8c96661c-3f0f-df59-3d32-e84fdb8c2ccb/hadoop-tmp-dir so I do NOT create it in target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41 2024-01-21 23:55:30,200 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-21 23:55:30,210 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.cache 2024-01-21 23:55:30,210 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:30,210 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:30,210 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:30,211 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6585218258624415755_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-01-21 23:55:31,311 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.persistence 2024-01-21 23:55:31,311 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:31,311 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:31,311 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:31,329 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.cache 2024-01-21 23:55:31,329 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:31,330 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:31,332 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:31,333 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18a77510-398a-69e4-d0f4-3a81be938d41/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:31,334 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:31,334 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:31,334 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:31,334 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:31,343 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=95 (was 91) - Thread LEAK? -, OpenFileDescriptor=296 (was 295) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 376), ProcessCount=167 (was 167), AvailableMemoryMB=16229 (was 16261) 2024-01-21 23:55:31,351 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testMemoryLeak[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=95, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=167, AvailableMemoryMB=16228 2024-01-21 23:55:31,362 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:31,369 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:31,369 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:31,369 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:33,620 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:33,620 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:33,620 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:33,620 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:33,629 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testMemoryLeak[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=97 (was 95) - Thread LEAK? -, OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 346), ProcessCount=167 (was 167), AvailableMemoryMB=16131 (was 16228) 2024-01-21 23:55:33,637 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=95, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=167, AvailableMemoryMB=16131 2024-01-21 23:55:33,647 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,654 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:33,654 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:33,656 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:33,666 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,671 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.2, multiFactor: 0.4, memoryFactor: 0.4 2024-01-21 23:55:33,671 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:33,672 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:33,672 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,679 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,684 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,693 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:33,693 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:33,693 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:33,693 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:33,702 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=99 (was 95) - Thread LEAK? -, OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 346), ProcessCount=167 (was 167), AvailableMemoryMB=16004 (was 16131) 2024-01-21 23:55:33,710 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRAMCache[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=99, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=167, AvailableMemoryMB=16004 2024-01-21 23:55:33,720 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,725 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:33,725 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:33,727 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:33,727 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:33,727 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:33,727 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:33,727 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:33,735 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRAMCache[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=101 (was 99) - Thread LEAK? -, OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 346), ProcessCount=167 (was 167), AvailableMemoryMB=15980 (was 16004) 2024-01-21 23:55:33,743 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=99, OpenFileDescriptor=296, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=167, AvailableMemoryMB=15979 2024-01-21 23:55:33,753 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-21 23:55:33,759 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-21 23:55:33,759 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-21 23:55:33,760 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-21 23:55:33,760 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-21 23:55:33,760 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-21 23:55:33,760 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-21 23:55:33,760 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-21 23:55:33,768 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[1: blockSize=16,384, bucketSizes=[I@3c22fc4c] Thread=100 (was 99) - Thread LEAK? -, OpenFileDescriptor=296 (was 296), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 346), ProcessCount=167 (was 167), AvailableMemoryMB=15951 (was 15979)