2024-04-18 15:56:06,646 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache timeout: 26 mins 2024-04-18 15:56:06,908 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7 2024-04-18 15:56:06,968 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=484, ProcessCount=185, AvailableMemoryMB=5113 2024-04-18 15:56:06,998 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:07,006 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:07,018 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:07,020 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:07,024 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-18 15:56:09,872 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:09,872 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:09,872 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:09,872 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:09,886 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[0: blockSize=8,192, bucketSizes=null] Thread=10 (was 10), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=869 (was 484) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=4387 (was 5113) 2024-04-18 15:56:09,898 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=869, ProcessCount=185, AvailableMemoryMB=4387 2024-04-18 15:56:09,907 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:09,919 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:09,922 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:09,924 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:09,932 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=21474836480, buckets=5, bucket capacity=4294967296=(4*1073741824)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:09,932 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:09,933 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:09,932 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:09,932 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:09,946 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[0: blockSize=8,192, bucketSizes=null] Thread=12 (was 10) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 org.apache.log4j.Category.callAppenders(Category.java:205) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:982) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 org.apache.maven.surefire.booter.spi.EventChannelEncoder.encodeMessage(EventChannelEncoder.java:376) org.apache.maven.surefire.booter.spi.EventChannelEncoder.setOutErr(EventChannelEncoder.java:172) org.apache.maven.surefire.booter.spi.EventChannelEncoder.testOutput(EventChannelEncoder.java:168) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:99) org.apache.maven.surefire.api.booter.ForkingRunListener.writeTestOutput(ForkingRunListener.java:43) org.apache.maven.surefire.common.junit4.JUnit4RunListener.writeTestOutput(JUnit4RunListener.java:202) org.apache.maven.surefire.api.report.ConsoleOutputCapture$ForwardingPrintStream.write(ConsoleOutputCapture.java:57) sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291) sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295) sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141) java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229) org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:54) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:317) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:982) - Thread LEAK? -, OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=869 (was 869), ProcessCount=185 (was 185), AvailableMemoryMB=4363 (was 4387) 2024-04-18 15:56:09,962 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=10, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=869, ProcessCount=185, AvailableMemoryMB=4362 2024-04-18 15:56:09,970 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:09,980 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:09,980 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:09,981 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:10,006 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:10,017 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:10,030 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.0, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:10,030 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:10,031 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:10,031 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:10,040 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:10,048 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:10,048 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:10,048 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:10,048 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:10,061 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=14 (was 10) Potentially hanging thread: BucketCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-BucketCacheWriter-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1156) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:968) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1156) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:968) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1156) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:968) - Thread LEAK? -, OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=869 (was 869), ProcessCount=185 (was 185), AvailableMemoryMB=4195 (was 4362) 2024-04-18 15:56:10,073 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[0: blockSize=8,192, bucketSizes=null] Thread=14, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=869, ProcessCount=185, AvailableMemoryMB=4194 2024-04-18 15:56:10,080 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:10,088 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:10,088 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:10,089 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:10,199 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-18 15:56:10,551 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-18 15:56:10,565 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.cache 2024-04-18 15:56:10,565 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:10,565 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:10,566 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=1, writerQLen=1, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:10,721 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.persistence 2024-04-18 15:56:10,721 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:10,886 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.cache 2024-04-18 15:56:10,886 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:10,886 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:10,960 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:10,966 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:10,983 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:10,983 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:10,983 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:10,983 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:10,996 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[0: blockSize=8,192, bucketSizes=null] Thread=21 (was 14) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=290 (was 289) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=869 (was 869), ProcessCount=185 (was 185), AvailableMemoryMB=4302 (was 4194) - AvailableMemoryMB LEAK? - 2024-04-18 15:56:11,008 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=869, ProcessCount=185, AvailableMemoryMB=4302 2024-04-18 15:56:11,022 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:11,028 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:11,029 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:11,031 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:12,096 WARN [Time-limited test] hfile.BlockCacheUtil(227): Cached block contents differ by nextBlockOnDiskSize, the existing block has nextBlockOnDiskSize set, Keeping cached block. 2024-04-18 15:56:13,197 WARN [Time-limited test] hfile.BlockCacheUtil(223): Cached block contents differ by nextBlockOnDiskSize, the new block has nextBlockOnDiskSize set. Caching new block. 2024-04-18 15:56:14,298 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:14,298 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:14,298 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:14,299 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:14,314 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[0: blockSize=8,192, bucketSizes=null] Thread=19 (was 19), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 869), ProcessCount=185 (was 185), AvailableMemoryMB=4268 (was 4302) 2024-04-18 15:56:14,327 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=4268 2024-04-18 15:56:14,339 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:14,347 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:14,347 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:14,348 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:14,841 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=1073737728, buckets=511, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:14,842 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:14,842 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:14,842 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:14,842 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:14,859 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[0: blockSize=8,192, bucketSizes=null] Thread=19 (was 19), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=4215 (was 4268) 2024-04-18 15:56:14,871 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=19, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=4210 2024-04-18 15:56:14,883 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:14,891 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:14,892 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:14,896 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:14,907 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:14,918 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:14,956 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.0, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:14,957 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:14,959 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:14,959 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:14,971 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.2, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:14,971 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:14,972 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:14,972 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:14,983 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 1.05, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:14,983 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:14,983 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:14,984 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:14,984 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:14,984 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:14,984 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:14,998 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=32 (was 19) - Thread LEAK? -, OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3975 (was 4210) 2024-04-18 15:56:15,012 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[0: blockSize=8,192, bucketSizes=null] Thread=31, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3975 2024-04-18 15:56:15,023 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:15,030 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:15,030 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:15,031 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:15,041 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir so I do NOT create it in target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42 2024-04-18 15:56:15,042 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir Erasing configuration value by system value. 2024-04-18 15:56:15,042 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir so I do NOT create it in target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42 2024-04-18 15:56:15,042 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir Erasing configuration value by system value. 2024-04-18 15:56:15,042 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42 2024-04-18 15:56:15,042 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-18 15:56:15,053 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.cache 2024-04-18 15:56:15,053 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:15,053 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:15,053 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:15,054 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5953328504683209532_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,155 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.persistence 2024-04-18 15:56:16,155 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:16,155 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:16,155 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:16,170 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.cache 2024-04-18 15:56:16,170 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,170 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,173 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,176 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,176 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.persistence 2024-04-18 15:56:16,176 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:16,176 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:16,176 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:16,191 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.cache 2024-04-18 15:56:16,191 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,193 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,198 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,198 WARN [Time-limited test] bucket.BucketAllocator(412): There are 1 blocks which can't be rebuilt because there is no matching bucket size for these blocks 2024-04-18 15:56:16,198 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3fa9c4a3-4f29-d170-914e-5d8c26661c42/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,199 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:16,199 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:16,199 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:16,199 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:16,212 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[0: blockSize=8,192, bucketSizes=null] Thread=36 (was 31) - Thread LEAK? -, OpenFileDescriptor=291 (was 290) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3931 (was 3975) 2024-04-18 15:56:16,224 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheSimple[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3931 2024-04-18 15:56:16,235 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,247 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,248 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,249 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,607 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,622 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.69 MB, memory=0 B 2024-04-18 15:56:16,623 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,625 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.68 MB, memory=0 B 2024-04-18 15:56:16,626 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,628 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.46 MB, memory=0 B 2024-04-18 15:56:16,629 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,631 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.24 MB, memory=0 B 2024-04-18 15:56:16,632 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,634 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.64 MB, memory=0 B 2024-04-18 15:56:16,634 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,636 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.42 MB, memory=0 B 2024-04-18 15:56:16,637 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,638 DEBUG [Time-limited test-BucketCacheWriter-0] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.20 MB, memory=0 B 2024-04-18 15:56:16,653 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,655 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.59 MB, memory=0 B 2024-04-18 15:56:16,656 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,657 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.38 MB, memory=0 B 2024-04-18 15:56:16,657 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,659 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.16 MB, memory=0 B 2024-04-18 15:56:16,660 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,661 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.55 MB, memory=0 B 2024-04-18 15:56:16,661 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,662 DEBUG [Time-limited test-BucketCacheWriter-2] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.33 MB, memory=0 B 2024-04-18 15:56:16,685 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8691226971024638663_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,685 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7606364782463892794_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,686 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -487971372710698993_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,686 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7050459090977761770_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,686 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3245433375161729998_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,687 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1773317359596791083_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,687 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3110482897265145030_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,687 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2624607209557928824_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,688 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7254758179870465762_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,688 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1270473262214671593_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,688 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5299978342041750654_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,689 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6912548228842101822_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,689 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2696909340788209465_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,689 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4404898993924257350_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,690 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6240420747541559973_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,690 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -137465312841504538_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,690 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9102122009598727891_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,690 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4574404677047323383_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,691 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7779888998074737217_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,691 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4112058357025361078_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,691 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7153738790495563718_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,692 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1089534111489503736_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,692 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5783409800012870194_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,692 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3175318263098541287_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,692 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4359997197060621447_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,692 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7474089211846596703_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,693 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7547531843326520529_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,693 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2161298237524547236_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,693 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1089418397585981617_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,693 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8453714770046701684_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,693 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5344568170099956405_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,693 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7666677213646955968_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,694 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4049261256373888168_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,694 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4952606391093785123_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,694 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5237761428971699900_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,694 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4125348037398253508_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,694 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -334348084622378960_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,695 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4027156664427082050_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,695 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3095322045330386428_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,695 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -458072441285330155_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,695 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6202786707718307366_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,695 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6097903834027028357_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,695 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 961276064416842945_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,696 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7822795390377037547_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,696 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1340487774927918703_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,696 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5546338119878582602_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,696 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6821341829425105349_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,697 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5733023408069942510_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,697 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1943142055422126228_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,697 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6393452561440128340_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,698 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2048974793609774636_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,698 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6220550684567705936_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,698 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1955241550914756842_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,699 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -925774175112996882_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,699 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1810637575335610409_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,699 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1429919476937291547_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,699 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5580549227237402299_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,699 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7742704817843821023_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,700 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5811462171318697912_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,700 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9118419198364116385_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,700 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -384158671977235153_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,700 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7604420270673345326_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,701 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 872882226819821737_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,701 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8255779808508777243_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,701 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4029504574783494819_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,701 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 167234837715059229_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,701 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8637346246499484963_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,702 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4414360915442057288_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,702 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5546235670810185558_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,702 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 971291984983353513_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,702 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6029351472468151409_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,702 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8828621215800519811_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,703 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9191333377393420132_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,703 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1911442045522490601_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,703 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5507316405718986960_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,703 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,703 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5405181677758313682_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,704 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -994269275182394632_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,704 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7250867637316202105_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,704 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2813425177129478641_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,704 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4807918240147595642_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,704 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.72 MB, memory=0 B 2024-04-18 15:56:16,704 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8664091004367424490_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,705 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8384287100968247000_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,705 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5193952283873922554_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,705 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5415503275894751427_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,705 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,705 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6250939689630196167_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,706 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1285479278191216309_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,706 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7964362323826298769_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,706 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8586481369527558176_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,706 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3350393749004340769_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,706 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=2.11 MB, memory=0 B 2024-04-18 15:56:16,706 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3837330867139191830_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,707 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3355535484962449282_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,707 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,707 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8797651684360761109_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,707 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3067541566215906168_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,707 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4828644571852779967_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,708 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4651513458093104248_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,708 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8936282886072444542_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,708 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5215551521922747671_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,708 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.89 MB, memory=0 B 2024-04-18 15:56:16,708 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5232020921664661239_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,708 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4149650636330711279_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,709 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(844): Free started because "Full!"; Free for bucketSize(17408)=595 KB, Free for total=595 KB, of current used=3.98 MB, actual cacheSize=2.29 MB, total=30.06 MB 2024-04-18 15:56:16,709 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2853170212972670074_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,709 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -713156517419751136_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,709 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9159693957289022965_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,709 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4741415194020756960_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,709 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7959363557396402215_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,710 DEBUG [Time-limited test-BucketCacheWriter-1] bucket.BucketCache(929): Bucket cache free space completed; freed=224.90 KB, total=30.06 MB, single=0 B, multi=1.67 MB, memory=0 B 2024-04-18 15:56:16,710 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6692011889323448791_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,710 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1475702003378383599_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,710 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8767396702063227470_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,710 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8856784124999808470_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,710 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1509356273882240219_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,711 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1171573692278360948_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,711 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1526148820020144985_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,711 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5975766916486996527_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,711 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7479263331437481153_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,711 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4644610446817646633_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,711 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3039632366830609461_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,712 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3180777075166189556_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,712 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5917444599589008898_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,712 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 677103653135513632_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,712 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4764814779080743760_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,712 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4842172661651257989_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,713 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5950166818889339152_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,713 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2129248934415854155_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,713 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5247918109468736839_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,713 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2897372850322975369_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,713 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1617644406259821654_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,714 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6192619905607824458_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,714 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3849074756161015228_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,714 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5163750115053259127_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,714 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 442523928157336484_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,714 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5577737559715365247_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,714 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1977818579825036582_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,715 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2641037301956510953_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,715 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4200119586476496065_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,715 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2363915307904558743_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,715 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9202605986227780993_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,715 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3332555983570122346_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,715 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2538864201112737140_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,716 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8331269662711742679_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,716 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4301911526724952806_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,716 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7249728764498384989_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,716 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -447703735437808635_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,716 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8177386681566880512_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,716 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1477177133288792642_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1169746696329051607_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 424202980907295629_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -809146465934262154_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4084756455372685893_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6315801951595403172_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4103687545352171871_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,717 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8983142154917243848_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,718 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -871532753931623538_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,718 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5526585225433933046_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,718 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7891572769348974106_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,718 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7003762658001305483_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,718 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5427885996312679304_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,718 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8258078733816207977_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,719 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2277870805844151590_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,719 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8079408680410701581_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,719 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1961767091389596308_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,719 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3063046565770393547_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,719 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4101246979916025848_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,719 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6748896344927691854_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,720 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1659779811159845614_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,720 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4735127033750723457_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,720 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1071320462929311634_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,720 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2343334641916934869_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,720 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8904610601852947898_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8027984949588673367_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5349696009197631091_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2150119644213740280_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2363942109415538686_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -57570638443490667_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -408961828000981463_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,721 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1691719413006386646_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,722 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9075303243106018386_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,722 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4732509387956000549_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,722 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2062187471205299152_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,722 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -553525244414131889_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,722 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1406819942503384799_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,722 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3779397762544789017_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,723 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2371779416596426628_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,723 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3677467826395592454_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,723 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5887779041281271827_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,723 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5072390347319843004_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,723 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 714376261381926465_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,723 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3664278225283598680_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,724 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5814220394817525882_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,724 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7384480603965653552_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,724 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9118716495490748482_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,724 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 943945508946813671_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,724 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5777863228975595691_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,724 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6865691722456240438_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,725 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -632911393491157773_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,725 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3979504595594308932_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,725 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6805235064408853853_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,725 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4059806560158534575_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,725 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4275784385675299939_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,725 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8861684360076425819_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,726 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9139717218567715873_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,726 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8866227550990663872_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,726 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4000968769754942353_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,726 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7552334406237396387_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,726 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8793183435561595116_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,726 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7408284186375443124_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,727 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7181422379964859854_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,727 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5918771772333279843_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,727 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6888756214953793107_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,728 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8767733843529801369_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,728 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1653052590968938699_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,728 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7740572532434626275_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,728 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3788499699813154967_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,728 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -536446683164120307_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,728 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 690676686071101113_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,729 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5282164398664702566_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,729 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7807354036312448518_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,729 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -445892037674705898_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,729 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5702218376614034553_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6428406672695757541_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5297762541514129401_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6402354913469383158_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2752664307612375083_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7390491000908660959_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8574647171109599083_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,730 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6286607206842948811_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,731 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 560691306325542579_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,731 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7760610729167170434_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,731 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1139705678842230803_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,731 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7953359279175800703_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,731 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1646027253081620925_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,731 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5588034729374024414_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,732 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8222153007010487709_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,732 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8823021839423046972_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,732 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1932979114002678246_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,732 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8065257105122242602_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,732 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8790856061653830392_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,732 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3539804366576809453_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,733 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7982368728686629087_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,736 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7491350702939860571_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,736 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2988935048725261276_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,736 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4362834361467642489_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,736 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3018337760066533975_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,736 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7109433973203455150_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4927634139799518839_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7330063850933058514_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5020472798970957093_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1608343395745082224_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6828988738599917623_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8587492260494489270_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,737 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6017635999196868569_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7880933868780531402_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3852863746470448512_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5792967586727143743_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2670374205220556182_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9185652245710010585_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6267220852245746772_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,738 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6775561512804553986_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2616220986902626993_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1054249728452930912_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8318772328454903204_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1114127022795869217_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8836829773907625272_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8211945331068898330_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,739 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -785981545192459805_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4682576668906870505_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7261001217215475825_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2625470630551534737_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3902925011266310597_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -830076746154929613_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1686818283528996311_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,740 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6477221423336990315_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,741 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6950877714884230118_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,741 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5600801869031558549_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,741 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7503176665438031738_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,741 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6449111569735362168_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:16,742 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:16,742 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:16,742 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:16,743 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:16,759 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheSimple[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=184 (was 185), AvailableMemoryMB=3894 (was 3931) 2024-04-18 15:56:16,771 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3893 2024-04-18 15:56:16,785 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,794 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,794 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,794 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,795 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=true 2024-04-18 15:56:16,795 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=true 2024-04-18 15:56:16,795 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=true 2024-04-18 15:56:16,795 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:16,807 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3861 (was 3893) 2024-04-18 15:56:16,818 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocator[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3860 2024-04-18 15:56:16,830 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,838 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,838 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,839 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(652): Bucket allocator statistics follow: 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(653): Free bytes=20314112; used bytes=10435584; total bytes=30749696; wasted bytes=70656; fragmentation bytes=728064; completelyFreeBuckets=10 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 5120; used=410; free=0; total=410; wasted bytes=2048; fragmentation bytes=419840, full buckets=1 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 9216; used=228; free=0; total=228; wasted bytes=0; fragmentation bytes=233472, full buckets=1 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 17408; used=0; free=120; total=120; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 33792; used=0; free=62; total=62; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 41984; used=0; free=50; total=50; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 50176; used=0; free=41; total=41; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 58368; used=0; free=36; total=36; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 66560; used=31; free=0; total=31; wasted bytes=37888; fragmentation bytes=31744, full buckets=1 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 99328; used=42; free=0; total=42; wasted bytes=30720; fragmentation bytes=43008, full buckets=2 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 132096; used=0; free=15; total=15; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 197632; used=0; free=10; total=10; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 263168; used=0; free=7; total=7; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,842 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 394240; used=0; free=5; total=5; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,843 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 525312; used=0; free=4; total=4; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:16,844 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:16,844 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:16,844 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:16,844 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:16,856 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocator[0: blockSize=8,192, bucketSizes=null] Thread=35 (was 35), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3830 (was 3860) 2024-04-18 15:56:16,867 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=35, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3829 2024-04-18 15:56:16,878 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,885 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,886 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,887 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,897 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,904 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,911 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,922 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.86, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,922 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,923 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,923 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,933 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:16,933 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:16,937 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:16,937 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:16,949 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=43 (was 35) Potentially hanging thread: pool-55-thread-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-55-thread-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3668 (was 3829) 2024-04-18 15:56:16,964 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[0: blockSize=8,192, bucketSizes=null] Thread=39, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3668 2024-04-18 15:56:16,975 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:16,984 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:16,985 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:16,986 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:16,996 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:17,005 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.9, minFactor: 0.5, extraFreeFactor: 0.5, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-04-18 15:56:17,005 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:17,005 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:17,006 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:17,006 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:17,006 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:17,006 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:17,020 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[0: blockSize=8,192, bucketSizes=null] Thread=43 (was 39) - Thread LEAK? -, OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3605 (was 3668) 2024-04-18 15:56:17,031 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testGetPartitionSize[0: blockSize=8,192, bucketSizes=null] Thread=43, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3605 2024-04-18 15:56:17,041 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:17,047 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:17,048 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:17,048 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:17,058 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:17,066 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.5, extraFreeFactor: 0.1, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-04-18 15:56:17,066 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:17,067 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:17,067 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:17,067 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:17,067 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:17,067 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:17,080 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testGetPartitionSize[0: blockSize=8,192, bucketSizes=null] Thread=47 (was 43) - Thread LEAK? -, OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=808 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3548 (was 3605) 2024-04-18 15:56:17,091 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[0: blockSize=8,192, bucketSizes=null] Thread=47, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=808, ProcessCount=185, AvailableMemoryMB=3548 2024-04-18 15:56:17,101 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:17,107 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:17,107 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:17,107 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:17,108 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir so I do NOT create it in target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111 2024-04-18 15:56:17,108 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir so I do NOT create it in target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111 2024-04-18 15:56:17,108 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-18 15:56:17,118 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.cache 2024-04-18 15:56:17,118 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:17,118 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:17,119 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:17,119 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4531979551456786236_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:18,220 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.persistence 2024-04-18 15:56:18,220 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:18,220 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:18,220 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:18,234 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.cache 2024-04-18 15:56:18,234 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:18,234 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:18,237 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:18,237 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.cache, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/476e53e7-b794-f1c2-dd6b-c993b3f08111/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:18,238 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:18,238 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:18,238 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:18,238 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:18,251 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[0: blockSize=8,192, bucketSizes=null] Thread=51 (was 47) - Thread LEAK? -, OpenFileDescriptor=292 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 808), ProcessCount=185 (was 185), AvailableMemoryMB=3508 (was 3548) 2024-04-18 15:56:18,266 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testMemoryLeak[0: blockSize=8,192, bucketSizes=null] Thread=51, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3508 2024-04-18 15:56:18,277 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:18,283 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:18,283 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:18,285 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:20,537 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:20,537 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:20,537 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:20,537 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:20,550 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testMemoryLeak[0: blockSize=8,192, bucketSizes=null] Thread=52 (was 51) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=185 (was 185), AvailableMemoryMB=3471 (was 3508) 2024-04-18 15:56:20,561 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=51, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3470 2024-04-18 15:56:20,572 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,578 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:20,579 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:20,579 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:20,603 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,610 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.2, multiFactor: 0.4, memoryFactor: 0.4 2024-04-18 15:56:20,610 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:20,611 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:20,612 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,621 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,630 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,638 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:20,638 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:20,638 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:20,638 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:20,651 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[0: blockSize=8,192, bucketSizes=null] Thread=55 (was 51) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=185 (was 185), AvailableMemoryMB=3315 (was 3470) 2024-04-18 15:56:20,662 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRAMCache[0: blockSize=8,192, bucketSizes=null] Thread=55, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3314 2024-04-18 15:56:20,673 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,679 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:20,679 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:20,680 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:20,681 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:20,681 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:20,681 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:20,681 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:20,693 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRAMCache[0: blockSize=8,192, bucketSizes=null] Thread=55 (was 55), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=185 (was 185), AvailableMemoryMB=3283 (was 3314) 2024-04-18 15:56:20,705 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[0: blockSize=8,192, bucketSizes=null] Thread=55, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3283 2024-04-18 15:56:20,715 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,722 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:20,722 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:20,722 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=8 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:20,723 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:20,723 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:20,723 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:20,723 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:20,736 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[0: blockSize=8,192, bucketSizes=null] Thread=56 (was 55) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=185 (was 185), AvailableMemoryMB=3251 (was 3283) 2024-04-18 15:56:20,752 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=55, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3251 2024-04-18 15:56:20,763 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:20,770 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:20,770 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:20,771 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:21,752 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:21,752 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:21,752 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:21,752 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:21,765 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheMultiThreadedSingleKey[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=56 (was 55) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=188 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=3362 (was 3251) - AvailableMemoryMB LEAK? - 2024-04-18 15:56:21,780 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=55, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=188, AvailableMemoryMB=3362 2024-04-18 15:56:21,790 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,795 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:21,795 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:21,796 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:21,801 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=21474836480, buckets=5, bucket capacity=4294967296=(4*1073741824)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:21,802 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:21,802 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:21,802 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:21,802 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:21,814 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocatorLargeBuckets[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=56 (was 55) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=188 (was 188), AvailableMemoryMB=3347 (was 3362) 2024-04-18 15:56:21,826 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=55, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=188, AvailableMemoryMB=3346 2024-04-18 15:56:21,842 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,847 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:21,847 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:21,848 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:21,858 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,863 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,870 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.0, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:21,870 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:21,874 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:21,875 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,880 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,886 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:21,886 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:21,886 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:21,886 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:21,899 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidMinFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=59 (was 55) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=185 (was 188), AvailableMemoryMB=3304 (was 3346) 2024-04-18 15:56:21,910 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=59, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3304 2024-04-18 15:56:21,921 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:21,923 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:21,923 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:21,923 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:21,924 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir so I do NOT create it in target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715 2024-04-18 15:56:21,924 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir so I do NOT create it in target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715 2024-04-18 15:56:21,924 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-18 15:56:21,934 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.cache 2024-04-18 15:56:21,934 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:21,935 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:21,935 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=1, writerQLen=1, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:22,079 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.persistence 2024-04-18 15:56:22,079 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:22,093 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.cache 2024-04-18 15:56:22,093 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:22,093 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:22,096 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:22,097 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c4839cc3-2d56-ebbc-ace1-a00eb69c0715/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:22,098 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:22,098 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:22,098 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:22,098 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:22,110 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBlockAdditionWaitWhenCache[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=63 (was 59) - Thread LEAK? -, OpenFileDescriptor=293 (was 292) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 743), ProcessCount=185 (was 185), AvailableMemoryMB=3303 (was 3304) 2024-04-18 15:56:22,121 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=63, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=3303 2024-04-18 15:56:22,131 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:22,136 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:22,136 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:22,137 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:23,238 WARN [Time-limited test] hfile.BlockCacheUtil(227): Cached block contents differ by nextBlockOnDiskSize, the existing block has nextBlockOnDiskSize set, Keeping cached block. 2024-04-18 15:56:24,338 WARN [Time-limited test] hfile.BlockCacheUtil(223): Cached block contents differ by nextBlockOnDiskSize, the new block has nextBlockOnDiskSize set. Caching new block. 2024-04-18 15:56:25,439 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:25,439 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:25,439 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:25,439 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:25,454 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheBlockNextBlockMetadataMissing[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=64 (was 63) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 743), ProcessCount=185 (was 185), AvailableMemoryMB=3276 (was 3303) 2024-04-18 15:56:25,466 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=63, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3275 2024-04-18 15:56:25,478 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,484 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,484 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,485 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,486 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=1073737728, buckets=511, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,486 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:25,486 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:25,487 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:25,490 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:25,499 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBlockWhenIOEngineWriteFailure[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=65 (was 63) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=3254 (was 3275) 2024-04-18 15:56:25,512 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=63, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3254 2024-04-18 15:56:25,524 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,532 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,532 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,532 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,542 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,547 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,553 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.0, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,553 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,553 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,553 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,557 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.2, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,558 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,558 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,558 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,565 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 1.05, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,565 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,566 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,566 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:25,566 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:25,566 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:25,566 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:25,578 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidExtraFreeFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=75 (was 63) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=3159 (was 3254) 2024-04-18 15:56:25,590 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=75, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3159 2024-04-18 15:56:25,602 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:25,610 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,611 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,611 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,622 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir so I do NOT create it in target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1 2024-04-18 15:56:25,622 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir Erasing configuration value by system value. 2024-04-18 15:56:25,622 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir so I do NOT create it in target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1 2024-04-18 15:56:25,622 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir Erasing configuration value by system value. 2024-04-18 15:56:25,622 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1 2024-04-18 15:56:25,622 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-18 15:56:25,632 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.cache 2024-04-18 15:56:25,632 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:25,632 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:25,633 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:25,633 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2954183008216775249_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:26,733 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.persistence 2024-04-18 15:56:26,733 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:26,733 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:26,733 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:26,748 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.cache 2024-04-18 15:56:26,748 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:26,748 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:26,751 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:26,751 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:26,752 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:26,752 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:26,752 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.persistence 2024-04-18 15:56:26,752 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:26,765 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.cache 2024-04-18 15:56:26,765 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:26,766 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:26,769 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33546240, buckets=1638, bucket capacity=20480=(4*5120)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:26,769 WARN [Time-limited test] bucket.BucketAllocator(412): There are 1 blocks which can't be rebuilt because there is no matching bucket size for these blocks 2024-04-18 15:56:26,771 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dc404c0d-53f2-5bc6-0bb4-5faeb5369cd1/bucket.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:26,772 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:26,772 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:26,772 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:26,772 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:26,784 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRetrieveFromFile[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=80 (was 75) - Thread LEAK? -, OpenFileDescriptor=294 (was 293) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=3127 (was 3159) 2024-04-18 15:56:26,796 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testCacheSimple[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=79, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3127 2024-04-18 15:56:26,807 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:26,811 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:26,811 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:26,812 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,156 ERROR [Time-limited test-BucketCacheWriter-1] util.ResourceLeakDetector(337): LEAK: RefCnt.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information. Recent access records: #1: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.release(RefCnt.java:83) org.apache.hadoop.hbase.nio.ByteBuff.release(ByteBuff.java:87) org.apache.hadoop.hbase.io.hfile.HFileBlock.release(HFileBlock.java:420) org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:237) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:461) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:446) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:420) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:409) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #2: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:543) org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:216) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:461) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:446) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:420) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:409) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #3: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:543) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:150) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Created at: org.apache.hadoop.hbase.nio.RefCnt.(RefCnt.java:59) org.apache.hadoop.hbase.nio.RefCnt.create(RefCnt.java:54) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.(BucketEntry.java:110) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1501) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1061) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:974) 2024-04-18 15:56:27,167 ERROR [Time-limited test-BucketCacheWriter-2] util.ResourceLeakDetector(337): LEAK: RefCnt.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information. Recent access records: #1: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.release(RefCnt.java:83) org.apache.hadoop.hbase.nio.ByteBuff.release(ByteBuff.java:87) org.apache.hadoop.hbase.io.hfile.HFileBlock.release(HFileBlock.java:420) org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:237) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:461) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:446) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:420) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:409) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #2: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:543) org.apache.hadoop.hbase.io.hfile.BlockCacheUtil.shouldReplaceExistingCacheBlock(BlockCacheUtil.java:216) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.shouldReplaceExistingCacheBlock(BucketCache.java:461) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlockWithWait(BucketCache.java:446) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:420) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:128) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.cacheBlock(BucketCache.java:409) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache$MockedBucketCache.cacheBlock(TestBucketCache.java:133) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:151) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #3: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:543) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:150) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) #4: org.apache.hadoop.hbase.nio.RefCnt.maybeRecord(RefCnt.java:120) org.apache.hadoop.hbase.nio.RefCnt.retain(RefCnt.java:71) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:414) org.apache.hadoop.hbase.nio.SingleByteBuff.retain(SingleByteBuff.java:37) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:410) org.apache.hadoop.hbase.io.hfile.HFileBlock.retain(HFileBlock.java:109) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:543) org.apache.hadoop.hbase.io.hfile.CacheTestUtils.testCacheSimple(CacheTestUtils.java:140) org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache.testCacheSimple(TestBucketCache.java:213) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.runners.ParentRunner.run(ParentRunner.java:413) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Created at: org.apache.hadoop.hbase.nio.RefCnt.(RefCnt.java:59) org.apache.hadoop.hbase.nio.RefCnt.create(RefCnt.java:54) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.(BucketEntry.java:110) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1501) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1061) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:974) 2024-04-18 15:56:27,211 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4560021147089994203_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7920855358013957155_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7210647595472593033_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6099014519225111575_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2320710957865630818_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5820691299068890964_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5010172831454833215_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3311727259451947242_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4926338127817888654_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,212 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8582545444542313200_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3753206528009419954_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6646599232700503751_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2610793059897670515_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3609473649945108937_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7243608271286114697_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1379541100036824869_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7520060303338822030_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5353309512848729147_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2685516296786490959_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4029489805158447287_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7632033852001957762_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3552059068532128786_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1785450170761316669_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1551412958303771016_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 739107570118422058_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,213 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5501486425608340544_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8361323033263964772_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2895274631942299399_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6826862124124010598_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7703675104682864293_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4909080845334679108_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4121466275305420743_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8567246599665571786_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8537756644904907521_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1418847796403141152_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3177530131525960969_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4889612775869349847_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2492880616898964853_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8851305513903014922_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8438627104658662115_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4391494193502386808_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,214 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4263424126278994563_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4862036581997079270_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8745362748708915835_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6564985187087393453_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2022721457604880822_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8888502787732540176_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3801536842324179417_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 230533779693232239_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5159567558280978263_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4062419008075772284_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7648160577243122631_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5238025471181402904_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3309323290390963795_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3313641725086643316_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4924354064833082377_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -301641303306253936_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,215 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3739208847714595611_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9039810705784836704_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1147049330526523793_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4532927782022441465_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2053378917506890031_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 242930554651862813_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2850091284642922555_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1901839439148855024_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7493579242758983526_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7976300343273358999_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6174600942073918007_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4681169687147334128_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2109886181170144988_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9038265353870850552_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2296736206136736694_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7839439846475108256_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,216 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7558079975455896771_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2202637063428989731_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3987029366563879341_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6710147271279500109_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6343484354588138438_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4864514192756035031_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3604897475809728478_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8369052528183586752_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7834487032975544225_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9078249683421415224_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8787526565759704635_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1483014309258509577_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7969434435102737773_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6318746297323579225_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2563442017951051643_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4848977528451972661_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,217 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8108695906266750322_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1397766232025870329_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8634854671457192288_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4408230760190797738_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4396940432575213857_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5654133234628306023_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7608025274151548160_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4222958288838026479_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5809331153918298725_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8911138967076222765_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -708956733021278749_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3980131539150552516_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3888568270575866532_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7073295823080955851_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6048619219916214414_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6040026889425728813_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,218 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8096849894577310195_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8026449718059584113_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7624876348031141286_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5741958136948633637_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3049921587516490632_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6414133015280599131_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9019446917406193005_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8950274150178079726_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -358574440111204274_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4393537290652244234_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -648638130419583767_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 835629255607795263_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8395352873724664185_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2123539200657297671_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5595472092360267996_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1780381460795889117_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,219 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3860542468480546389_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6622939058610130689_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4367456216297711509_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9031308949569169395_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4155268396734011589_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7985237528936595013_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4793710037688832274_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9193030870656170069_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -254137734025085015_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7205869549360509001_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1678944037330723121_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7894726334929093849_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1587442311751429395_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2469029248348701309_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3089469185060147827_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2470411689128570143_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6628216768237119275_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,220 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3046984908318966006_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6919265647760559177_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -275997906334825093_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5854574199116355291_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2612222421489866365_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5490033272841584583_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7095993866472684445_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4448995028884665916_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 765622838266105315_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9080061389691916716_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8719491862225750068_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,221 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3155917669929090903_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2388122672243414428_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1445987056817140655_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6048179340090410044_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1893617750008568124_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3170937166279647881_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4148749385008370376_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8467611590402704909_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1177873072414406533_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8186893347054941679_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1103547226255238439_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7153044336830129885_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2949807751525687683_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,222 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5375378713673153126_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5246715440366161571_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7912033937101984620_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6954861310176476000_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 975453671326451506_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1788943059391016839_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4884761008757674170_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8844278111220951660_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1528006059425663028_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3975203299821259900_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2796795641600757387_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1078735918110313027_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8521993535263481294_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 988206401048133455_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8648417157454181222_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1768937511069483208_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6962908389426546856_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,223 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 733999591786388461_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1182712472056816434_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 121808676413834252_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8725415900418095069_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8843029993922047219_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1948136589539608033_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5592258796118838430_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3059787604715097812_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8839340293650742749_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -941999025546531097_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7096482073313450055_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7232022812163906251_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 985793404718774500_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5989561985833293166_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1158697710951028383_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 9042540175869878223_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2754843905099144359_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2098852593667923064_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,224 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7417973437239456539_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -551533320925408056_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4918367758597036303_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3145983483344520202_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5980606169133413937_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -751544519950314377_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1065705643712075963_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1936299698095318511_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2796232956887557026_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -155595255296422961_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4485225403901748974_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2145795929897459766_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3496359238571483082_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8542430257358489630_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1354028950478045123_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,225 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7451057783264028571_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5589971695470255038_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3399171100760981337_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4008850877898283322_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -824096361308119249_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 476441754503460903_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6526825346686468671_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 464345590969551431_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7007379039891902533_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6965409789245432095_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4765146093872461207_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4376907384716400478_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6489840564964008654_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3432825730168038350_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,226 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1364848170565798706_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9088643895249522326_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6144322703348828995_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3363756412734905423_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3238647356785378855_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6878834261496327695_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8726431936139718929_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2170767025727402398_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2064203937727787587_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6677316611393926278_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,227 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7624999841314534213_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5379336586008191352_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8747234017826910253_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3129239390671031091_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4267364209628509976_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7233789516845536810_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1808181395001964230_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6178115785752624511_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8802332744769671087_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,228 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7195997321731086580_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4730612860203895591_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8181170274838125779_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 988639074165083270_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4924694270684549726_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1787531864856592987_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5347721301542322567_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 335110319058614676_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2323624133446397517_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8012078661970638085_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -45400055462940373_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3390128129450344546_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,229 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2868067718627832203_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1139886385642666776_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7201031251217292711_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7294288678740010839_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3056643566883817601_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2331346691003091188_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5264950948564767519_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9032304962127644934_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8550498809333845460_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,230 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6693619455039785112_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8311501056262659712_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4087773304250837814_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7041286429521952120_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9020139112986856005_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -169267506161894000_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4865036513942197599_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 319982406187156520_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3256498463006102667_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6897767036554832826_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3959011686315043671_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7845590769715878130_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2391610022557198365_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8298314587423508615_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8610622971256680612_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3032382801343318320_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7914371506244990118_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,231 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4494116447660346327_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8663299575551979952_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5276700292107688982_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3295224043027196456_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4680060276944874990_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -902800811154279683_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5907770278443687750_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1368609442186071005_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8025169225368101884_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5433639888976943736_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5575595809873999284_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8922451898686529330_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1171689053140024315_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 989966941037652536_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 596202759813857602_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5204187880939828366_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,232 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5112694218253782617_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2662738093696406228_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5412229251269599778_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 205987220228262451_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 153389950434953372_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4903908050418193563_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -927642991190422147_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1588960037698831930_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4659749998289992738_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7143801073311198011_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1987052898560090435_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6869019654084184525_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4879038006125087925_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2608018763248958707_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3665927616768749785_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6239897250474456956_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,233 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5721650709715585861_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8643381403691410756_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7710166660399206939_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6236356920505223500_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3286872241313180930_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8530579348835032397_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8555047591076829013_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 670502731923587929_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2687539871172761792_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5939077316662419429_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 2497119286761876199_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6954464368198040908_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2748164440998401769_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1077846292888482938_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2045822698942091438_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 801028642217985686_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 1338377802152092359_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2485322175573077313_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,234 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4753047123729633603_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1782339859447572781_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7429602478182281700_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8435690986809290942_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7759976793508731224_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2796151839120618228_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2728008231142787804_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7744562065927271281_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5872286616777475744_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5133405561966862479_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6218507120417638392_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7079430797740184530_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -9109030743892516555_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 4152339687534240661_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8106776280966018274_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5259404945791221401_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -8672307102864842438_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,235 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 850955515193959140_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2272107228849689752_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3868581853937565194_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4331732584936081887_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7693719178799978576_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 243408407975753724_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8506005509628230825_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5057156389005872077_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6274520333569682659_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 5036510762600718601_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 6257038557317539955_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -3178290914331405488_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4738547370844268866_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3436419323424115668_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2898075130797940099_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -7144955713961609303_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3831832325663889721_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,236 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 7574130050741973985_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4904641388686885144_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5634680780225638586_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -2123263295429927899_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -1505965947952478866_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 463092344063561621_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -5272404502167538611_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3472137734399723513_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 8440929109072431294_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4916264724727581280_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: 3448425331891865467_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,237 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -6551460214494345178_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:27,240 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:27,240 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:27,240 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:27,240 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:27,253 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testCacheSimple[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=79 (was 79), OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=3111 (was 3127) 2024-04-18 15:56:27,265 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=79, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3110 2024-04-18 15:56:27,275 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,279 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,279 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,280 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,280 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=true 2024-04-18 15:56:27,280 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=true 2024-04-18 15:56:27,280 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=true 2024-04-18 15:56:27,280 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:27,293 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testHeapSizeChanges[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=80 (was 79) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=3102 (was 3110) 2024-04-18 15:56:27,306 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testBucketAllocator[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=79, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3102 2024-04-18 15:56:27,316 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,321 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,321 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,321 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(652): Bucket allocator statistics follow: 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(653): Free bytes=2590720; used bytes=28246016; total bytes=30836736; wasted bytes=2400256; fragmentation bytes=704512; completelyFreeBuckets=5 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 3072; used=0; free=172; total=172; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 5120; used=206; free=0; total=206; wasted bytes=2048; fragmentation bytes=210944, full buckets=2 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 9216; used=171; free=0; total=171; wasted bytes=9216; fragmentation bytes=175104, full buckets=3 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 17408; used=0; free=30; total=30; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 29696; used=0; free=17; total=17; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 33792; used=0; free=15; total=15; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 66560; used=161; free=0; total=161; wasted bytes=1436672; fragmentation bytes=164864, full buckets=23 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 99328; used=150; free=0; total=150; wasted bytes=952320; fragmentation bytes=153600, full buckets=30 2024-04-18 15:56:27,322 DEBUG [Time-limited test] bucket.BucketAllocator(659): Object size 132096; used=0; free=4; total=4; wasted bytes=0; fragmentation bytes=0, full buckets=0 2024-04-18 15:56:27,323 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:27,323 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:27,323 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:27,323 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:27,336 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testBucketAllocator[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=81 (was 79) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=3082 (was 3102) 2024-04-18 15:56:27,347 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=79, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=185, AvailableMemoryMB=3082 2024-04-18 15:56:27,358 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,361 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,361 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,362 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,372 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,380 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,389 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,396 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.86, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,396 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,397 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,397 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,405 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:27,405 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:27,409 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:27,409 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:27,422 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidAcceptFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=85 (was 79) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 684), ProcessCount=185 (was 185), AvailableMemoryMB=2958 (was 3082) 2024-04-18 15:56:27,435 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=83, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2958 2024-04-18 15:56:27,451 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,456 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,456 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,456 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,466 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,471 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.9, minFactor: 0.5, extraFreeFactor: 0.5, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-04-18 15:56:27,471 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,472 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,472 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:27,472 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:27,472 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:27,472 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:27,485 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testValidBucketCacheConfigs[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=87 (was 83) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2915 (was 2958) 2024-04-18 15:56:27,496 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testGetPartitionSize[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=87, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2914 2024-04-18 15:56:27,506 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,510 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,510 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,513 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,523 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,531 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.5, extraFreeFactor: 0.1, singleFactor: 0.1, multiFactor: 0.7, memoryFactor: 0.2 2024-04-18 15:56:27,532 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,532 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,532 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:27,532 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:27,532 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:27,532 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:27,545 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testGetPartitionSize[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=91 (was 87) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2875 (was 2914) 2024-04-18 15:56:27,557 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=91, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2875 2024-04-18 15:56:27,566 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:27,573 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,574 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,575 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,575 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-log-dir so I do NOT create it in target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200 2024-04-18 15:56:27,575 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0b249ca-aa62-d881-4130-696454047dc7/hadoop-tmp-dir so I do NOT create it in target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200 2024-04-18 15:56:27,575 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-18 15:56:27,585 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.cache 2024-04-18 15:56:27,585 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:27,585 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:27,586 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:27,586 DEBUG [Time-limited test] hfile.BlockCacheUtil(231): Caching an already cached block: -4792603729444119330_0. This is harmless and can happen in rare cases (see HBASE-8547) 2024-04-18 15:56:28,687 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=true; path to write=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.persistence 2024-04-18 15:56:28,687 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:28,687 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:28,687 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:28,701 INFO [Time-limited test] bucket.FileIOEngine(96): Allocating cache 32 MB, on the path:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.cache 2024-04-18 15:56:28,701 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:28,701 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:28,704 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:28,704 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.cache, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7e00c6e1-9add-0e56-161c-503cb8c19200/bucketNoRecycler.persistence, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:28,705 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:28,705 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:28,705 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:28,705 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:28,718 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testFreeBucketEntryRestoredFromFile[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=95 (was 91) - Thread LEAK? -, OpenFileDescriptor=295 (was 294) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2846 (was 2875) 2024-04-18 15:56:28,730 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testMemoryLeak[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=95, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2846 2024-04-18 15:56:28,740 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:28,746 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:28,746 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:28,746 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:30,998 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:30,998 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:30,998 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:30,998 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:31,012 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testMemoryLeak[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=95 (was 95), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2823 (was 2846) 2024-04-18 15:56:31,026 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=95, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2823 2024-04-18 15:56:31,038 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,046 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:31,046 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:31,049 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:31,060 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,064 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.2, multiFactor: 0.4, memoryFactor: 0.4 2024-04-18 15:56:31,065 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:31,065 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:31,065 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,074 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,082 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,089 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:31,089 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:31,089 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:31,089 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:31,102 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testInvalidCacheSplitFactorConfig[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=99 (was 95) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2695 (was 2823) 2024-04-18 15:56:31,114 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testRAMCache[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=99, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2695 2024-04-18 15:56:31,124 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,131 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:31,132 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:31,132 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:31,132 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:31,132 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:31,132 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:31,132 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:31,144 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testRAMCache[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=100 (was 99) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2662 (was 2695) 2024-04-18 15:56:31,156 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=99, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=661, ProcessCount=185, AvailableMemoryMB=2662 2024-04-18 15:56:31,167 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-18 15:56:31,171 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-18 15:56:31,171 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=33288192, buckets=63, bucket capacity=528384=(4*132096)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-18 15:56:31,172 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=16 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-18 15:56:31,172 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-18 15:56:31,172 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-18 15:56:31,172 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-18 15:56:31,172 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-18 15:56:31,185 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.bucket.TestBucketCache#testOffsetProducesPositiveOutput[1: blockSize=16,384, bucketSizes=[I@3eb7fc54] Thread=99 (was 99), OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=661 (was 661), ProcessCount=185 (was 185), AvailableMemoryMB=2634 (was 2662)