2024-01-28 01:55:25,198 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.TestHFile timeout: 13 mins 2024-01-28 01:55:25,418 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/72498835-76d8-e0ef-30a7-3dc788db62cd 2024-01-28 01:55:25,537 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-28 01:55:25,906 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-28 01:55:25,929 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testEmptyHFile Thread=11, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=167, AvailableMemoryMB=3146 2024-01-28 01:55:25,949 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-28 01:55:26,045 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-28 01:55:26,125 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-28 01:55:26,157 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testEmptyHFile 2024-01-28 01:55:26,375 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testEmptyHFile Thread=13 (was 11) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=291 (was 290) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 177) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3689 (was 3146) - AvailableMemoryMB LEAK? - 2024-01-28 01:55:26,382 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=13, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3688 2024-01-28 01:55:26,397 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-01-28 01:55:26,421 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on bd41ffb9f8654a3fb5671631c15555b9 2024-01-28 01:55:26,510 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=13 (was 13), OpenFileDescriptor=292 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3667 (was 3688) 2024-01-28 01:55:26,518 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=13, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3666 2024-01-28 01:55:26,538 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-01-28 01:55:26,560 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on c1802a63192c4fbf936cfd652819cdf7 2024-01-28 01:55:26,597 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-28 01:55:26,618 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-28 01:55:26,629 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-28 01:55:26,641 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-28 01:55:26,643 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-28 01:55:26,650 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key c1802a63192c4fbf936cfd652819cdf7_116246 had block type DATA, but was found in L1 cache. 2024-01-28 01:55:26,657 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-28 01:55:26,657 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-28 01:55:26,657 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-28 01:55:26,657 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-28 01:55:26,667 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=13 (was 13), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3589 (was 3666) 2024-01-28 01:55:26,674 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=13, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3587 2024-01-28 01:55:27,195 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=13 (was 13), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3498 (was 3587) 2024-01-28 01:55:27,205 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=13, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3497 2024-01-28 01:55:27,209 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testCorruptTruncatedHFile 2024-01-28 01:55:27,236 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=13 (was 13), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3493 (was 3497) 2024-01-28 01:55:27,243 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=13, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3491 2024-01-28 01:55:27,259 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-01-28 01:55:27,263 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on b078bc20dcfa4cf1bbfc8f8bae37f4b0 2024-01-28 01:55:27,283 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-28 01:55:27,287 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-28 01:55:27,296 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-28 01:55:27,297 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-28 01:55:27,300 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-28 01:55:27,303 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key b078bc20dcfa4cf1bbfc8f8bae37f4b0_116741 had block type DATA, but was found in L1 cache. 2024-01-28 01:55:27,303 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-28 01:55:27,304 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-28 01:55:27,304 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-28 01:55:27,303 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-28 01:55:27,312 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=13 (was 13), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3443 (was 3491) 2024-01-28 01:55:27,320 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=13, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3441 2024-01-28 01:55:27,329 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=13 (was 13), OpenFileDescriptor=293 (was 292) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3440 (was 3441) 2024-01-28 01:55:27,336 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=13, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3438 2024-01-28 01:55:27,350 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-01-28 01:55:27,353 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 4b71a4a7ea52475f84014aa22a70c55b 2024-01-28 01:55:27,369 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=13 (was 13), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3430 (was 3438) 2024-01-28 01:55:27,376 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testMetaBlocks Thread=13, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3429 2024-01-28 01:55:27,421 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testMetaBlocks Thread=13 (was 13), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3417 (was 3429) 2024-01-28 01:55:27,428 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testGetShortMidpoint Thread=13, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3414 2024-01-28 01:55:27,440 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testGetShortMidpoint Thread=13 (was 13), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=166 (was 167), AvailableMemoryMB=3411 (was 3414) 2024-01-28 01:55:27,447 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCompressionOrdinance Thread=13, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3410 2024-01-28 01:55:27,453 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCompressionOrdinance Thread=13 (was 13), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3407 (was 3410) 2024-01-28 01:55:27,459 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=13, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3405 2024-01-28 01:55:27,471 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-01-28 01:55:27,474 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 66338243803c45d7af622b2e0309f5ad 2024-01-28 01:55:27,495 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-28 01:55:27,542 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-28 01:55:27,557 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-28 01:55:27,558 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-28 01:55:27,558 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-28 01:55:27,574 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key 66338243803c45d7af622b2e0309f5ad_115403 had block type DATA, but was found in L1 cache. 2024-01-28 01:55:27,580 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-28 01:55:27,580 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-28 01:55:27,580 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-28 01:55:27,580 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-28 01:55:27,592 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=14 (was 13) Potentially hanging thread: ForkJoinPool.commonPool-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3352 (was 3405) 2024-01-28 01:55:27,601 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testTFileFeatures Thread=14, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3351 2024-01-28 01:55:27,608 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@59418659, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-01-28 01:55:27,627 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@aeb529b, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-01-28 01:55:27,652 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@654f8421, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-01-28 01:55:27,666 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@63b28ae, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-01-28 01:55:27,685 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testTFileFeatures Thread=14 (was 14), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3334 (was 3351) 2024-01-28 01:55:27,692 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testDBEShipped Thread=14, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3333 2024-01-28 01:55:27,696 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_PREFIX 2024-01-28 01:55:27,701 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_DIFF 2024-01-28 01:55:27,706 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_FAST_DIFF 2024-01-28 01:55:27,710 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_ROW_INDEX_V1 2024-01-28 01:55:27,720 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testDBEShipped Thread=14 (was 14), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3323 (was 3333) 2024-01-28 01:55:27,727 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testShortMidpointSameQual Thread=14, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3319 2024-01-28 01:55:27,736 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testShortMidpointSameQual Thread=14 (was 14), OpenFileDescriptor=293 (was 293), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3319 (was 3319) 2024-01-28 01:55:27,745 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testNullMetaBlocks Thread=14, OpenFileDescriptor=293, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3318 2024-01-28 01:55:27,761 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testNullMetaBlocks Thread=14 (was 14), OpenFileDescriptor=295 (was 293) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3317 (was 3318) 2024-01-28 01:55:27,768 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=14, OpenFileDescriptor=295, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=3316 2024-01-28 01:55:27,784 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-01-28 01:55:27,790 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 37eea93712314ec2a342417e36ad17e8 2024-01-28 01:55:27,813 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-28 01:55:27,814 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-01-28 01:55:27,829 INFO [Time-limited test] bucket.BucketCache(278): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-01-28 01:55:27,829 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-01-28 01:55:27,836 INFO [Time-limited test] bucket.BucketCache(320): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-01-28 01:55:27,839 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key 37eea93712314ec2a342417e36ad17e8_116673 had block type DATA, but was found in L1 cache. 2024-01-28 01:55:27,840 INFO [Time-limited test] bucket.BucketCache(1319): Shutdown bucket cache: IO persistent=false; path to write=null 2024-01-28 01:55:27,840 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-01-28 01:55:27,840 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-01-28 01:55:27,844 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(980): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-01-28 01:55:27,851 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=16 (was 14) Potentially hanging thread: BucketCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-BucketCacheWriter-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1154) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:966) - Thread LEAK? -, OpenFileDescriptor=295 (was 295), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=167 (was 167), AvailableMemoryMB=3267 (was 3316)