2023-10-04 00:57:58,374 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.TestHFile timeout: 13 mins 2023-10-04 00:57:58,545 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/36a1d35a-abeb-c318-6145-84a2f26c1856 2023-10-04 00:57:58,649 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-04 00:57:58,932 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-04 00:57:58,949 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testEmptyHFile Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5639 2023-10-04 00:57:58,964 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-04 00:57:59,037 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-04 00:57:59,104 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-04 00:57:59,140 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testEmptyHFile 2023-10-04 00:57:59,340 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testEmptyHFile Thread=13 (was 11) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=264 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=170 (was 170), AvailableMemoryMB=5589 (was 5639) 2023-10-04 00:57:59,348 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=13, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5588 2023-10-04 00:57:59,369 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-10-04 00:57:59,393 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 010613a9d5c747de9cc0c25be0bcbc1e 2023-10-04 00:57:59,502 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=13 (was 13), OpenFileDescriptor=265 (was 264) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=170 (was 170), AvailableMemoryMB=5580 (was 5588) 2023-10-04 00:57:59,510 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=13, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=171, AvailableMemoryMB=5579 2023-10-04 00:57:59,527 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-10-04 00:57:59,551 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on f439a60879e64f2d82ada0aad78d43cb 2023-10-04 00:57:59,583 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:57:59,608 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-10-04 00:57:59,645 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-10-04 00:57:59,660 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-10-04 00:57:59,664 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-10-04 00:57:59,686 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-10-04 00:57:59,686 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-10-04 00:57:59,686 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-10-04 00:57:59,687 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-10-04 00:57:59,699 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=13 (was 13), OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=170 (was 171), AvailableMemoryMB=5542 (was 5579) 2023-10-04 00:57:59,708 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=13, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5542 2023-10-04 00:58:00,368 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=13 (was 13), OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=170 (was 170), AvailableMemoryMB=5492 (was 5542) 2023-10-04 00:58:00,386 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=13, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5491 2023-10-04 00:58:00,399 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testCorruptTruncatedHFile 2023-10-04 00:58:00,439 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=13 (was 13), OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=5489 (was 5491) 2023-10-04 00:58:00,450 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=13, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5489 2023-10-04 00:58:00,468 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-10-04 00:58:00,479 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 5039056d82854cf5a3d3c46aaa0781ee 2023-10-04 00:58:00,505 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:58:00,514 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-10-04 00:58:00,534 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-10-04 00:58:00,535 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-10-04 00:58:00,551 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-10-04 00:58:00,558 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-10-04 00:58:00,559 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-10-04 00:58:00,559 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-10-04 00:58:00,566 ERROR [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(975): WriterThread encountered error java.lang.IllegalArgumentException: ReferenceCount : 0 (expected: > 0) at org.apache.hbase.thirdparty.io.netty.util.internal.ObjectUtil.checkPositive(ObjectUtil.java:100) at org.apache.hadoop.hbase.nio.ByteBuff.checkRefCount(ByteBuff.java:77) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:683) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:43) at org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:506) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1503) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) 2023-10-04 00:58:00,574 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-10-04 00:58:00,575 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=16 (was 13) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:43) org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:506) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1503) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) Potentially hanging thread: Time-limited test-BucketCacheWriter-0 java.lang.System.arraycopy(Native Method) java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:567) java.lang.StringBuffer.append(StringBuffer.java:363) org.apache.log4j.helpers.ISO8601DateFormat.format(ISO8601DateFormat.java:155) java.text.DateFormat.format(DateFormat.java:345) org.apache.log4j.helpers.PatternParser$DatePatternConverter.convert(PatternParser.java:411) org.apache.log4j.helpers.PatternConverter.format(PatternConverter.java:63) org.apache.log4j.PatternLayout.format(PatternLayout.java:510) org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:303) org.apache.log4j.WriterAppender.append(WriterAppender.java:156) org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:232) org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57) org.apache.log4j.Category.callAppenders(Category.java:206) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:981) Potentially hanging thread: BucketCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=170 (was 170), AvailableMemoryMB=5473 (was 5489) 2023-10-04 00:58:00,586 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=13, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5472 2023-10-04 00:58:00,601 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=13 (was 13), OpenFileDescriptor=266 (was 265) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 308), ProcessCount=170 (was 170), AvailableMemoryMB=5470 (was 5472) 2023-10-04 00:58:00,614 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=13, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=170, AvailableMemoryMB=5466 2023-10-04 00:58:00,629 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-10-04 00:58:00,642 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 3a308d517af6480e9ef3a4aea0e679f8 2023-10-04 00:58:00,679 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=15 (was 13) Potentially hanging thread: LruBlockCacheStatsExecutor Potentially hanging thread: Time-limited test.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 308) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=5458 (was 5466) 2023-10-04 00:58:00,690 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testMetaBlocks Thread=13, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5457 2023-10-04 00:58:00,767 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testMetaBlocks Thread=13 (was 13), OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5453 (was 5457) 2023-10-04 00:58:00,778 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testGetShortMidpoint Thread=13, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5453 2023-10-04 00:58:00,798 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testGetShortMidpoint Thread=13 (was 13), OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5453 (was 5453) 2023-10-04 00:58:00,808 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCompressionOrdinance Thread=13, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5453 2023-10-04 00:58:00,818 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCompressionOrdinance Thread=13 (was 13), OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5452 (was 5453) 2023-10-04 00:58:00,828 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=13, OpenFileDescriptor=268, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5452 2023-10-04 00:58:00,841 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-10-04 00:58:00,846 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on d0017919249f4025a7bad301f73f019e 2023-10-04 00:58:00,868 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:58:00,915 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-10-04 00:58:00,933 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-10-04 00:58:00,933 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-10-04 00:58:00,943 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-10-04 00:58:00,961 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-10-04 00:58:00,961 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-10-04 00:58:00,961 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-10-04 00:58:00,962 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-10-04 00:58:00,979 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=14 (was 13) Potentially hanging thread: ForkJoinPool.commonPool-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=266 (was 268), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5425 (was 5452) 2023-10-04 00:58:00,988 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testTFileFeatures Thread=14, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5424 2023-10-04 00:58:00,993 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@450bf9ae, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-10-04 00:58:01,014 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@601ec5fd, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-10-04 00:58:01,029 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@60c5bb6f, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-10-04 00:58:01,044 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@9b85a9b, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-10-04 00:58:01,068 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testTFileFeatures Thread=14 (was 14), OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5424 (was 5424) 2023-10-04 00:58:01,078 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testDBEShipped Thread=14, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5424 2023-10-04 00:58:01,083 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_PREFIX 2023-10-04 00:58:01,090 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_DIFF 2023-10-04 00:58:01,095 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_FAST_DIFF 2023-10-04 00:58:01,103 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_ROW_INDEX_V1 2023-10-04 00:58:01,113 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testDBEShipped Thread=14 (was 14), OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5418 (was 5424) 2023-10-04 00:58:01,122 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testShortMidpointSameQual Thread=14, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5417 2023-10-04 00:58:01,135 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testShortMidpointSameQual Thread=14 (was 14), OpenFileDescriptor=266 (was 266), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5416 (was 5417) 2023-10-04 00:58:01,145 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testNullMetaBlocks Thread=14, OpenFileDescriptor=266, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5414 2023-10-04 00:58:01,167 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testNullMetaBlocks Thread=14 (was 14), OpenFileDescriptor=268 (was 266) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5412 (was 5414) 2023-10-04 00:58:01,176 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=14, OpenFileDescriptor=268, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=170, AvailableMemoryMB=5412 2023-10-04 00:58:01,191 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-10-04 00:58:01,200 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 98a75a6023954096b9388ca27472af39 2023-10-04 00:58:01,218 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:58:01,219 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-10-04 00:58:01,232 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-10-04 00:58:01,233 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-10-04 00:58:01,239 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-10-04 00:58:01,242 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-10-04 00:58:01,242 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-10-04 00:58:01,242 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-10-04 00:58:01,242 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-10-04 00:58:01,251 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=14 (was 14), OpenFileDescriptor=268 (was 268), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 340), ProcessCount=170 (was 170), AvailableMemoryMB=5378 (was 5412)