2023-04-24 09:01:20,015 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.TestHFile timeout: 13 mins 2023-04-24 09:01:20,216 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5d516772-d219-a8cb-3eaa-18f29aab7d3a 2023-04-24 09:01:20,344 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-04-24 09:01:20,714 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-04-24 09:01:20,736 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testEmptyHFile Thread=9, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=165, AvailableMemoryMB=9912 2023-04-24 09:01:20,756 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-04-24 09:01:20,850 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-24 09:01:20,921 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-04-24 09:01:20,951 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testEmptyHFile 2023-04-24 09:01:21,140 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testEmptyHFile Thread=11 (was 9) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=261 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=165 (was 165), AvailableMemoryMB=9835 (was 9912) 2023-04-24 09:01:21,147 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=11, OpenFileDescriptor=261, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=165, AvailableMemoryMB=9834 2023-04-24 09:01:21,163 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 09:01:21,182 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 74f94140f24e4ec294056df94015f43e 2023-04-24 09:01:21,265 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=11 (was 11), OpenFileDescriptor=262 (was 261) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=165 (was 165), AvailableMemoryMB=9826 (was 9834) 2023-04-24 09:01:21,271 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=165, AvailableMemoryMB=9826 2023-04-24 09:01:21,289 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 09:01:21,305 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on b5b6a485dcf7417892e2380e27faeded 2023-04-24 09:01:21,333 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 09:01:21,349 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 09:01:21,358 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 09:01:21,371 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 09:01:21,376 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 09:01:21,392 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 09:01:21,392 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 09:01:21,392 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 09:01:21,395 ERROR [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(975): WriterThread encountered error java.lang.IllegalArgumentException: ReferenceCount : 0 (expected: > 0) at org.apache.hbase.thirdparty.io.netty.util.internal.ObjectUtil.checkPositive(ObjectUtil.java:100) at org.apache.hadoop.hbase.nio.ByteBuff.checkRefCount(ByteBuff.java:77) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:683) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:43) at org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:500) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1503) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) 2023-04-24 09:01:21,397 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 09:01:21,405 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=12 (was 11) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 org.apache.log4j.spi.ThrowableInformation.getThrowableStrRep(ThrowableInformation.java:84) org.apache.log4j.spi.LoggingEvent.getThrowableStrRep(LoggingEvent.java:417) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:306) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.error(Reload4jLoggerAdapter.java:555) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:975) - Thread LEAK? -, OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=9786 (was 9826) 2023-04-24 09:01:21,414 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9786 2023-04-24 09:01:21,987 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9690 (was 9786) 2023-04-24 09:01:21,996 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9689 2023-04-24 09:01:21,999 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testCorruptTruncatedHFile 2023-04-24 09:01:22,025 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9685 (was 9689) 2023-04-24 09:01:22,036 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9684 2023-04-24 09:01:22,050 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 09:01:22,059 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on bccb6eac3c804fcba6d5a2908801f56b 2023-04-24 09:01:22,082 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 09:01:22,087 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 09:01:22,098 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 09:01:22,098 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 09:01:22,103 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 09:01:22,107 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 09:01:22,108 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 09:01:22,108 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 09:01:22,108 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 09:01:22,122 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=15 (was 11) Potentially hanging thread: BucketCacheStatsExecutor java.lang.Exception.(Exception.java:54) java.lang.InterruptedException.(InterruptedException.java:57) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-BucketCacheWriter-2 java.lang.Thread.currentThread(Native Method) org.apache.log4j.spi.LoggingEvent.getThreadName(LoggingEvent.java:391) org.apache.log4j.helpers.PatternParser$BasicPatternConverter.convert(PatternParser.java:367) org.apache.log4j.helpers.PatternConverter.format(PatternConverter.java:63) org.apache.log4j.PatternLayout.format(PatternLayout.java:510) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:303) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:981) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 org.apache.log4j.Category.callAppenders(Category.java:211) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:981) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 org.apache.log4j.Category.callAppenders(Category.java:205) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:981) - Thread LEAK? -, OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9644 (was 9684) 2023-04-24 09:01:22,131 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9644 2023-04-24 09:01:22,142 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=11 (was 11), OpenFileDescriptor=263 (was 262) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9643 (was 9644) 2023-04-24 09:01:22,150 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9642 2023-04-24 09:01:22,166 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 09:01:22,171 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on dd1a20a2290743179a23f67f3422564f 2023-04-24 09:01:22,189 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=12 (was 11) Potentially hanging thread: Time-limited test.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9638 (was 9642) 2023-04-24 09:01:22,198 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testMetaBlocks Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=168, AvailableMemoryMB=9636 2023-04-24 09:01:22,252 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testMetaBlocks Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 168), AvailableMemoryMB=9635 (was 9636) 2023-04-24 09:01:22,259 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testGetShortMidpoint Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9635 2023-04-24 09:01:22,277 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testGetShortMidpoint Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9632 (was 9635) 2023-04-24 09:01:22,285 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCompressionOrdinance Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9631 2023-04-24 09:01:22,292 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCompressionOrdinance Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9631 (was 9631) 2023-04-24 09:01:22,299 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9631 2023-04-24 09:01:22,315 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 09:01:22,320 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on b93bcbbda37541dba1f4896fe8db45b1 2023-04-24 09:01:22,339 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 09:01:22,372 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 09:01:22,387 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 09:01:22,388 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 09:01:22,392 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 09:01:22,411 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 09:01:22,411 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 09:01:22,411 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 09:01:22,411 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 09:01:22,423 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=12 (was 11) Potentially hanging thread: ForkJoinPool.commonPool-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9590 (was 9631) 2023-04-24 09:01:22,430 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testTFileFeatures Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9590 2023-04-24 09:01:22,433 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@3457439, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 09:01:22,446 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@d3fa74b, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 09:01:22,461 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@48a5d306, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 09:01:22,474 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@3976576f, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 09:01:22,490 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testTFileFeatures Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9594 (was 9590) - AvailableMemoryMB LEAK? - 2023-04-24 09:01:22,496 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testDBEShipped Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9594 2023-04-24 09:01:22,501 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_PREFIX 2023-04-24 09:01:22,505 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_DIFF 2023-04-24 09:01:22,509 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_FAST_DIFF 2023-04-24 09:01:22,513 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_ROW_INDEX_V1 2023-04-24 09:01:22,520 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testDBEShipped Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9589 (was 9594) 2023-04-24 09:01:22,527 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testShortMidpointSameQual Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9588 2023-04-24 09:01:22,534 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testShortMidpointSameQual Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9588 (was 9588) 2023-04-24 09:01:22,541 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testNullMetaBlocks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9588 2023-04-24 09:01:22,554 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testNullMetaBlocks Thread=12 (was 12), OpenFileDescriptor=265 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9587 (was 9588) 2023-04-24 09:01:22,560 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=166, AvailableMemoryMB=9587 2023-04-24 09:01:22,570 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 09:01:22,573 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 30ebcbb61e3d4f35be7c1236f3002956 2023-04-24 09:01:22,586 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 09:01:22,587 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 09:01:22,590 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 09:01:22,591 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 09:01:22,591 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 09:01:22,593 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 09:01:22,594 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 09:01:22,594 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 09:01:22,594 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 09:01:22,603 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=12 (was 12), OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=166 (was 166), AvailableMemoryMB=9545 (was 9587)