2023-04-11 20:03:49,215 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.TestHFile timeout: 13 mins 2023-04-11 20:03:49,704 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4f7fb031-2229-bd77-e137-7044e2a0af61 2023-04-11 20:03:49,952 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-04-11 20:03:50,643 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-04-11 20:03:50,711 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testEmptyHFile Thread=9, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=807, ProcessCount=166, AvailableMemoryMB=5701 2023-04-11 20:03:50,743 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-04-11 20:03:50,952 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-11 20:03:51,149 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-04-11 20:03:51,215 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testEmptyHFile 2023-04-11 20:03:51,540 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testEmptyHFile Thread=11 (was 9) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=261 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=807 (was 807), ProcessCount=166 (was 166), AvailableMemoryMB=5655 (was 5701) 2023-04-11 20:03:51,568 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=11, OpenFileDescriptor=261, MaxFileDescriptor=60000, SystemLoadAverage=807, ProcessCount=166, AvailableMemoryMB=5655 2023-04-11 20:03:51,593 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-11 20:03:51,682 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 6baed0f1ce204dce944a766d6ae13221 2023-04-11 20:03:51,873 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=11 (was 11), OpenFileDescriptor=262 (was 261) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=807 (was 807), ProcessCount=166 (was 166), AvailableMemoryMB=5649 (was 5655) 2023-04-11 20:03:51,901 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=807, ProcessCount=166, AvailableMemoryMB=5647 2023-04-11 20:03:51,935 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-11 20:03:51,954 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 2dea011c84e947e1b48a17ff32aa50c1 2023-04-11 20:03:51,973 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-11 20:03:51,985 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-11 20:03:51,994 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-11 20:03:52,010 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-11 20:03:52,031 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-11 20:03:52,077 ERROR [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(975): WriterThread encountered error java.lang.IllegalArgumentException: ReferenceCount : 0 (expected: > 0) at org.apache.hbase.thirdparty.io.netty.util.internal.ObjectUtil.checkPositive(ObjectUtil.java:100) at org.apache.hadoop.hbase.nio.ByteBuff.checkRefCount(ByteBuff.java:77) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:683) at org.apache.hadoop.hbase.nio.MultiByteBuff.duplicate(MultiByteBuff.java:43) at org.apache.hadoop.hbase.io.hfile.HFileBlock.getBufferReadOnly(HFileBlock.java:500) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1503) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.doDrain(BucketCache.java:1059) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:973) 2023-04-11 20:03:52,084 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-11 20:03:52,084 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-11 20:03:52,084 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-11 20:03:52,085 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-11 20:03:52,135 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=807 (was 807), ProcessCount=166 (was 166), AvailableMemoryMB=5613 (was 5647) 2023-04-11 20:03:52,159 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=807, ProcessCount=166, AvailableMemoryMB=5613 2023-04-11 20:03:53,276 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 807) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=5566 (was 5613) 2023-04-11 20:03:53,298 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5565 2023-04-11 20:03:53,337 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testCorruptTruncatedHFile 2023-04-11 20:03:53,406 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5554 (was 5565) 2023-04-11 20:03:53,444 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=11, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5553 2023-04-11 20:03:53,462 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-11 20:03:53,498 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 737ce597f3a94e658d3cd419d88d8ea0 2023-04-11 20:03:53,534 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-11 20:03:53,570 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-11 20:03:53,655 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-11 20:03:53,656 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-11 20:03:53,680 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-11 20:03:53,685 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-11 20:03:53,685 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-11 20:03:53,685 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-11 20:03:53,685 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-11 20:03:53,713 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=11 (was 11), OpenFileDescriptor=262 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5530 (was 5553) 2023-04-11 20:03:53,732 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=11, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5530 2023-04-11 20:03:53,815 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=11 (was 11), OpenFileDescriptor=263 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5529 (was 5530) 2023-04-11 20:03:53,841 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=11, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5528 2023-04-11 20:03:53,855 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-11 20:03:53,878 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 1e016c70133d4f02b9203a9ce6183a6e 2023-04-11 20:03:53,921 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=12 (was 11) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=263 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5528 (was 5528) 2023-04-11 20:03:53,953 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testMetaBlocks Thread=11, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5528 2023-04-11 20:03:54,182 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testMetaBlocks Thread=11 (was 11), OpenFileDescriptor=263 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5528 (was 5528) 2023-04-11 20:03:54,219 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testGetShortMidpoint Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5528 2023-04-11 20:03:54,252 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testGetShortMidpoint Thread=11 (was 11), OpenFileDescriptor=265 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5527 (was 5528) 2023-04-11 20:03:54,277 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCompressionOrdinance Thread=11, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5527 2023-04-11 20:03:54,291 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCompressionOrdinance Thread=11 (was 11), OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5526 (was 5527) 2023-04-11 20:03:54,320 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=11, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5526 2023-04-11 20:03:54,334 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-11 20:03:54,348 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 2e3289ea96374ae6812da8f45a00eab9 2023-04-11 20:03:54,368 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-11 20:03:54,462 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-11 20:03:54,508 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-11 20:03:54,508 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-11 20:03:54,547 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-11 20:03:54,592 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-11 20:03:54,593 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-11 20:03:54,593 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-11 20:03:54,593 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-11 20:03:54,627 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=12 (was 11) Potentially hanging thread: ForkJoinPool.commonPool-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5500 (was 5526) 2023-04-11 20:03:54,650 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testTFileFeatures Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5500 2023-04-11 20:03:54,662 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@562f1f15, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-11 20:03:54,690 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@6e46dc8e, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-11 20:03:54,704 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@1e4b8724, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-11 20:03:54,721 INFO [Time-limited test] hfile.TestHFile(503): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@2220bc8f, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2023-04-11 20:03:54,758 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testTFileFeatures Thread=12 (was 12), OpenFileDescriptor=263 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5498 (was 5500) 2023-04-11 20:03:54,768 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testDBEShipped Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5498 2023-04-11 20:03:54,775 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_PREFIX 2023-04-11 20:03:54,782 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_DIFF 2023-04-11 20:03:54,786 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_FAST_DIFF 2023-04-11 20:03:54,791 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_ROW_INDEX_V1 2023-04-11 20:03:54,801 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testDBEShipped Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5494 (was 5498) 2023-04-11 20:03:54,816 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testShortMidpointSameQual Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5493 2023-04-11 20:03:54,833 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testShortMidpointSameQual Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5493 (was 5493) 2023-04-11 20:03:54,853 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testNullMetaBlocks Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5493 2023-04-11 20:03:54,920 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testNullMetaBlocks Thread=12 (was 12), OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5493 (was 5493) 2023-04-11 20:03:54,940 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=12, OpenFileDescriptor=265, MaxFileDescriptor=60000, SystemLoadAverage=861, ProcessCount=166, AvailableMemoryMB=5493 2023-04-11 20:03:54,961 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2023-04-11 20:03:54,987 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 5e4b813dd4ca44ce9a6f14d421017a60 2023-04-11 20:03:55,007 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-11 20:03:55,027 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2023-04-11 20:03:55,118 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2023-04-11 20:03:55,119 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2023-04-11 20:03:55,136 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2023-04-11 20:03:55,139 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2023-04-11 20:03:55,139 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2023-04-11 20:03:55,139 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(981): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2023-04-11 20:03:55,139 INFO [Time-limited test] bucket.BucketCache(1318): Shutdown bucket cache: IO persistent=false; path to write=null 2023-04-11 20:03:55,165 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=14 (was 12) Potentially hanging thread: BucketCacheStatsExecutor java.lang.Thread.exit(Thread.java:759) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 org.apache.log4j.Category.callAppenders(Category.java:211) org.apache.log4j.Category.forcedLog(Category.java:384) org.apache.log4j.Category.log(Category.java:810) org.slf4j.impl.Reload4jLoggerAdapter.info(Reload4jLoggerAdapter.java:284) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:981) - Thread LEAK? -, OpenFileDescriptor=265 (was 265), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=861 (was 861), ProcessCount=166 (was 166), AvailableMemoryMB=5461 (was 5493)