2023-04-24 05:57:58,799 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.TestHFile timeout: 13 mins 2023-04-24 05:57:59,075 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d35dcadd-ff03-674a-c071-8863ad5871c9 2023-04-24 05:57:59,217 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-04-24 05:57:59,667 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-04-24 05:57:59,697 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testEmptyHFile Thread=9, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=169, AvailableMemoryMB=9889 2023-04-24 05:57:59,718 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-04-24 05:57:59,844 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-24 05:57:59,944 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-04-24 05:57:59,989 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testEmptyHFile 2023-04-24 05:58:00,230 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testEmptyHFile Thread=11 (was 9) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=261 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 335) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=9782 (was 9889) 2023-04-24 05:58:00,238 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=11, OpenFileDescriptor=261, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9782 2023-04-24 05:58:00,261 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 05:58:00,288 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 2c863d2111a04b889199925b9a162c9b 2023-04-24 05:58:00,395 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=11 (was 11), OpenFileDescriptor=262 (was 261) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9767 (was 9782) 2023-04-24 05:58:00,405 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9767 2023-04-24 05:58:00,424 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 05:58:00,440 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on e51fa50e677e4a319e78f70f815d91ef 2023-04-24 05:58:00,476 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 05:58:00,495 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 05:58:00,512 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 05:58:00,527 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 05:58:00,530 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 05:58:00,547 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 05:58:00,547 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 05:58:00,547 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 05:58:00,555 ERROR [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(975): WriterThread encountered error java.lang.IllegalArgumentException: ReferenceCount : 0 (expected: > 0) at org.apache.hbase.thirdparty.io.netty.util.internal.ObjectUtil.checkPositive(ObjectUtil.java:100) at org.apache.hadoop.hbase.nio.ByteBuff.checkRefCount(ByteBuff.java:77) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:683) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:43) at org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:500) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1503) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) 2023-04-24 05:58:00,559 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 05:58:00,563 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=13 (was 11) Potentially hanging thread: BucketCacheStatsExecutor java.lang.Thread.isInterrupted(Native Method) java.lang.Thread.interrupted(Thread.java:952) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.checkInterruptWhileWaiting(AbstractQueuedSynchronizer.java:2002) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 sun.misc.Unsafe.defineAnonymousClass(Native Method) java.lang.invoke.InvokerBytecodeGenerator.loadAndInitializeInvokerClass(InvokerBytecodeGenerator.java:284) java.lang.invoke.InvokerBytecodeGenerator.loadMethod(InvokerBytecodeGenerator.java:276) java.lang.invoke.InvokerBytecodeGenerator.generateCustomizedCode(InvokerBytecodeGenerator.java:618) java.lang.invoke.LambdaForm.compileToBytecode(LambdaForm.java:654) java.lang.invoke.LambdaForm.prepare(LambdaForm.java:635) java.lang.invoke.MethodHandle.(MethodHandle.java:461) java.lang.invoke.BoundMethodHandle.(BoundMethodHandle.java:58) java.lang.invoke.BoundMethodHandle$Species_L.(BoundMethodHandle.java:211) java.lang.invoke.BoundMethodHandle$Species_L.copyWith(BoundMethodHandle.java:228) java.lang.invoke.MethodHandle.asCollector(MethodHandle.java:1002) java.lang.invoke.MethodHandleImpl$AsVarargsCollector.(MethodHandleImpl.java:460) java.lang.invoke.MethodHandleImpl$AsVarargsCollector.(MethodHandleImpl.java:454) java.lang.invoke.MethodHandleImpl.makeVarargsCollector(MethodHandleImpl.java:445) java.lang.invoke.MethodHandle.setVarargs(MethodHandle.java:1325) java.lang.invoke.MethodHandles$Lookup.getDirectMethodCommon(MethodHandles.java:1670) java.lang.invoke.MethodHandles$Lookup.getDirectMethodNoSecurityManager(MethodHandles.java:1617) java.lang.invoke.MethodHandles$Lookup.getDirectMethodForConstant(MethodHandles.java:1802) java.lang.invoke.MethodHandles$Lookup.linkMethodHandleConstant(MethodHandles.java:1751) java.lang.invoke.MethodHandleNatives.linkMethodHandleConstant(MethodHandleNatives.java:477) java.util.Comparator.comparingLong(Comparator.java:510) org.apache.hadoop.hbase.io.hfile.bucket.BucketEntry.(BucketEntry.java:49) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1497) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) - Thread LEAK? -, OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9728 (was 9767) 2023-04-24 05:58:00,571 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9728 2023-04-24 05:58:01,117 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9646 (was 9728) 2023-04-24 05:58:01,125 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9645 2023-04-24 05:58:01,128 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testCorruptTruncatedHFile 2023-04-24 05:58:01,160 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9642 (was 9645) 2023-04-24 05:58:01,170 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9641 2023-04-24 05:58:01,184 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 05:58:01,192 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on c021a69c99f943609ebaa3d8983bc020 2023-04-24 05:58:01,213 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 05:58:01,217 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 05:58:01,233 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 05:58:01,233 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 05:58:01,236 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 05:58:01,244 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 05:58:01,244 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 05:58:01,244 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 05:58:01,244 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 05:58:01,256 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9598 (was 9641) 2023-04-24 05:58:01,266 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9598 2023-04-24 05:58:01,277 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=11 (was 11), OpenFileDescriptor=263 (was 262) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9597 (was 9598) 2023-04-24 05:58:01,284 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9597 2023-04-24 05:58:01,298 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 05:58:01,302 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 606ef953bddb4299a2044dfe8694b1b9 2023-04-24 05:58:01,320 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9591 (was 9597) 2023-04-24 05:58:01,328 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testMetaBlocks Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9591 2023-04-24 05:58:01,387 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testMetaBlocks Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9583 (was 9591) 2023-04-24 05:58:01,397 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testGetShortMidpoint Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9583 2023-04-24 05:58:01,414 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testGetShortMidpoint Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9582 (was 9583) 2023-04-24 05:58:01,424 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCompressionOrdinance Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9582 2023-04-24 05:58:01,432 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCompressionOrdinance Thread=11 (was 11), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9581 (was 9582) 2023-04-24 05:58:01,440 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9581 2023-04-24 05:58:01,457 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 05:58:01,463 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on cb723e8d2e7841f99c83e40d02b6d1c8 2023-04-24 05:58:01,486 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 05:58:01,525 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 05:58:01,532 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 05:58:01,532 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 05:58:01,533 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 05:58:01,548 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 05:58:01,548 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 05:58:01,548 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 05:58:01,548 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 05:58:01,557 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=12 (was 11) Potentially hanging thread: ForkJoinPool.commonPool-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9536 (was 9581) 2023-04-24 05:58:01,563 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testTFileFeatures Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9535 2023-04-24 05:58:01,566 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@135b7c2a, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 05:58:01,581 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@7a1a3f24, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 05:58:01,593 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@1569ef60, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 05:58:01,604 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@2b290d34, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-24 05:58:01,619 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testTFileFeatures Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9528 (was 9535) 2023-04-24 05:58:01,625 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testDBEShipped Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9528 2023-04-24 05:58:01,630 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_PREFIX 2023-04-24 05:58:01,634 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_DIFF 2023-04-24 05:58:01,638 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_FAST_DIFF 2023-04-24 05:58:01,641 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_ROW_INDEX_V1 2023-04-24 05:58:01,649 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testDBEShipped Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9526 (was 9528) 2023-04-24 05:58:01,656 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testShortMidpointSameQual Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9525 2023-04-24 05:58:01,663 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testShortMidpointSameQual Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9525 (was 9525) 2023-04-24 05:58:01,670 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testNullMetaBlocks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9525 2023-04-24 05:58:01,685 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testNullMetaBlocks Thread=12 (was 12), OpenFileDescriptor=265 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9524 (was 9525) 2023-04-24 05:58:01,691 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=169, AvailableMemoryMB=9524 2023-04-24 05:58:01,704 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-24 05:58:01,708 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 19241cf736634b9c84814295735eaadf 2023-04-24 05:58:01,724 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-24 05:58:01,724 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-24 05:58:01,740 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-24 05:58:01,740 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-24 05:58:01,744 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-24 05:58:01,748 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-24 05:58:01,748 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-24 05:58:01,748 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-24 05:58:01,748 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-24 05:58:01,756 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=12 (was 12), OpenFileDescriptor=262 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 357), ProcessCount=169 (was 169), AvailableMemoryMB=9530 (was 9524) - AvailableMemoryMB LEAK? -