2024-04-27 03:00:53,890 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.io.hfile.TestHFile timeout: 13 mins 2024-04-27 03:00:54,067 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b47c8a4c-b8be-b5e7-159c-453b576e597e 2024-04-27 03:00:54,178 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-27 03:00:54,495 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-27 03:00:54,519 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testEmptyHFile Thread=11, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=183, AvailableMemoryMB=2384 2024-04-27 03:00:54,536 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-27 03:00:54,639 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-04-27 03:00:54,716 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-04-27 03:00:54,754 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testEmptyHFile 2024-04-27 03:00:55,511 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testEmptyHFile Thread=13 (was 11) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=290 (was 289) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 183), AvailableMemoryMB=2106 (was 2384) 2024-04-27 03:00:55,541 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=13, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=2105 2024-04-27 03:00:55,555 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-04-27 03:00:55,555 WARN [Time-limited test] io.ByteBuffAllocator(212): The minimal size for reservoir use is less or equal to zero, all allocations will be from the pool. Set a higher hbase.server.allocator.minimal.allocate.size to avoid this. 2024-04-27 03:00:55,574 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on f2c68619b6204ab5ae6145bce4dbda3c 2024-04-27 03:00:55,649 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithoutBlockCache Thread=14 (was 13) - Thread LEAK? -, OpenFileDescriptor=291 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=2095 (was 2105) 2024-04-27 03:00:55,658 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=14, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=2094 2024-04-27 03:00:55,675 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-04-27 03:00:55,675 WARN [Time-limited test] io.ByteBuffAllocator(212): The minimal size for reservoir use is less or equal to zero, all allocations will be from the pool. Set a higher hbase.server.allocator.minimal.allocate.size to avoid this. 2024-04-27 03:00:55,690 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on cb96472b882844b78e2b1ba3a935fafb 2024-04-27 03:00:55,716 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-27 03:00:55,733 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-27 03:00:55,739 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-27 03:00:55,751 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-27 03:00:55,756 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-27 03:00:55,766 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key cb96472b882844b78e2b1ba3a935fafb_116635 had block type DATA, but was found in L1 cache. 2024-04-27 03:00:55,773 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-27 03:00:55,773 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-27 03:00:55,773 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-27 03:00:55,773 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-27 03:00:55,787 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithAdaptiveLruCombinedBlockCache Thread=14 (was 14), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=182 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2008 (was 2094) 2024-04-27 03:00:55,797 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=14, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=2010 2024-04-27 03:00:56,266 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptOutOfOrderHFileWrite Thread=14 (was 14), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1979 (was 2010) 2024-04-27 03:00:56,275 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=14, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1978 2024-04-27 03:00:56,277 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testCorruptTruncatedHFile 2024-04-27 03:00:56,300 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorruptTruncatedHFile Thread=14 (was 14), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1978 (was 1978) 2024-04-27 03:00:56,308 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=14, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1977 2024-04-27 03:00:56,318 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-04-27 03:00:56,319 WARN [Time-limited test] io.ByteBuffAllocator(212): The minimal size for reservoir use is less or equal to zero, all allocations will be from the pool. Set a higher hbase.server.allocator.minimal.allocate.size to avoid this. 2024-04-27 03:00:56,323 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 11ab7b201d6946f4bc4991ccc0a24b98 2024-04-27 03:00:56,336 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-27 03:00:56,339 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-27 03:00:56,345 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-27 03:00:56,345 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-27 03:00:56,346 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-27 03:00:56,349 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key 11ab7b201d6946f4bc4991ccc0a24b98_117345 had block type DATA, but was found in L1 cache. 2024-04-27 03:00:56,349 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-27 03:00:56,349 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-27 03:00:56,349 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-27 03:00:56,350 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-27 03:00:56,359 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithCombinedBlockCache Thread=14 (was 14), OpenFileDescriptor=291 (was 291), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1941 (was 1977) 2024-04-27 03:00:56,367 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=14, OpenFileDescriptor=291, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1941 2024-04-27 03:00:56,378 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCorrupt0LengthHFile Thread=14 (was 14), OpenFileDescriptor=292 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1941 (was 1941) 2024-04-27 03:00:56,386 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=14, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1939 2024-04-27 03:00:56,395 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-04-27 03:00:56,395 WARN [Time-limited test] io.ByteBuffAllocator(212): The minimal size for reservoir use is less or equal to zero, all allocations will be from the pool. Set a higher hbase.server.allocator.minimal.allocate.size to avoid this. 2024-04-27 03:00:56,399 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on a72f71a7da9048629c77d4592f588142 2024-04-27 03:00:56,415 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLRUBlockCache Thread=14 (was 14), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1939 (was 1939) 2024-04-27 03:00:56,423 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testMetaBlocks Thread=14, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1939 2024-04-27 03:00:56,467 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testMetaBlocks Thread=14 (was 14), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1936 (was 1939) 2024-04-27 03:00:56,475 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testGetShortMidpoint Thread=14, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1936 2024-04-27 03:00:56,488 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testGetShortMidpoint Thread=14 (was 14), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1935 (was 1936) 2024-04-27 03:00:56,496 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testCompressionOrdinance Thread=14, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1935 2024-04-27 03:00:56,504 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testCompressionOrdinance Thread=14 (was 14), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1935 (was 1935) 2024-04-27 03:00:56,512 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=14, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1935 2024-04-27 03:00:56,523 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-04-27 03:00:56,523 WARN [Time-limited test] io.ByteBuffAllocator(212): The minimal size for reservoir use is less or equal to zero, all allocations will be from the pool. Set a higher hbase.server.allocator.minimal.allocate.size to avoid this. 2024-04-27 03:00:56,527 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 95ad0fbedd294e978cc5bd70dd3ec0a2 2024-04-27 03:00:56,549 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-27 03:00:56,580 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-27 03:00:56,584 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-27 03:00:56,585 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-27 03:00:56,586 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-27 03:00:56,594 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key 95ad0fbedd294e978cc5bd70dd3ec0a2_115394 had block type DATA, but was found in L1 cache. 2024-04-27 03:00:56,598 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-27 03:00:56,598 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-27 03:00:56,598 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-27 03:00:56,598 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-27 03:00:56,607 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithTinyLfuCombinedBlockCache Thread=15 (was 14) Potentially hanging thread: ForkJoinPool.commonPool-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1900 (was 1935) 2024-04-27 03:00:56,615 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testTFileFeatures Thread=15, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1900 2024-04-27 03:00:56,617 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@60d18317, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-04-27 03:00:56,630 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@597a3700, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-04-27 03:00:56,641 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@57d0210c, compression=none cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-04-27 03:00:56,651 INFO [Time-limited test] hfile.TestHFile(498): writer=null, name=org.apache.hadoop.fs.FSDataOutputStream@2d7006c7, compression=gz cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 0 2024-04-27 03:00:56,668 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testTFileFeatures Thread=15 (was 15), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1896 (was 1900) 2024-04-27 03:00:56,676 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testDBEShipped Thread=15, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1896 2024-04-27 03:00:56,681 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_PREFIX 2024-04-27 03:00:56,687 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_DIFF 2024-04-27 03:00:56,691 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_FAST_DIFF 2024-04-27 03:00:56,694 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on testDBEShipped_ROW_INDEX_V1 2024-04-27 03:00:56,704 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testDBEShipped Thread=15 (was 15), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1892 (was 1896) 2024-04-27 03:00:56,712 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testShortMidpointSameQual Thread=15, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1893 2024-04-27 03:00:56,720 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testShortMidpointSameQual Thread=15 (was 15), OpenFileDescriptor=292 (was 292), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1893 (was 1893) 2024-04-27 03:00:56,729 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testNullMetaBlocks Thread=15, OpenFileDescriptor=292, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1892 2024-04-27 03:00:56,747 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testNullMetaBlocks Thread=15 (was 15), OpenFileDescriptor=294 (was 292) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=181 (was 181), AvailableMemoryMB=1890 (was 1892) 2024-04-27 03:00:56,756 INFO [Time-limited test] hbase.ResourceChecker(147): before: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=15, OpenFileDescriptor=294, MaxFileDescriptor=60000, SystemLoadAverage=724, ProcessCount=181, AvailableMemoryMB=1890 2024-04-27 03:00:56,769 WARN [Time-limited test] io.ByteBuffAllocator(181): The config keys hbase.ipc.server.reservoir.initial.buffer.size and hbase.ipc.server.reservoir.initial.max are deprecated now, instead please use hbase.server.allocator.buffer.size and hbase.server.allocator.max.buffer.count. In future release we will remove the two deprecated configs. 2024-04-27 03:00:56,769 WARN [Time-limited test] io.ByteBuffAllocator(212): The minimal size for reservoir use is less or equal to zero, all allocations will be from the pool. Set a higher hbase.server.allocator.minimal.allocate.size to avoid this. 2024-04-27 03:00:56,773 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on ab5cc79d26824b43b9e8744049e48941 2024-04-27 03:00:56,790 INFO [Time-limited test] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-27 03:00:56,791 INFO [Time-limited test] util.ByteBufferArray(64): Allocating buffers total=32 MB, sizePerBuffer=2 MB, count=16 2024-04-27 03:00:56,794 INFO [Time-limited test] bucket.BucketCache(280): Instantiating BucketCache with acceptableFactor: 0.95, minFactor: 0.85, extraFreeFactor: 0.1, singleFactor: 0.25, multiFactor: 0.5, memoryFactor: 0.25 2024-04-27 03:00:56,795 INFO [Time-limited test] bucket.BucketAllocator(339): Cache totalSize=31518720, buckets=15, bucket capacity=2101248=(4*525312)=(FEWEST_ITEMS_IN_BUCKET*(largest configured bucketcache size)) 2024-04-27 03:00:56,796 INFO [Time-limited test] bucket.BucketCache(322): Started bucket cache; ioengine=offheap, capacity=32 MB, blockSize=64 KB, writerThreadNum=3, writerQLen=64, persistencePath=null, bucketAllocator=org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator 2024-04-27 03:00:56,798 WARN [Time-limited test] hfile.CombinedBlockCache(106): Cache key ab5cc79d26824b43b9e8744049e48941_115878 had block type DATA, but was found in L1 cache. 2024-04-27 03:00:56,798 INFO [Time-limited test] bucket.BucketCache(1321): Shutdown bucket cache: IO persistent=false; path to write=null 2024-04-27 03:00:56,798 INFO [Time-limited test-BucketCacheWriter-2] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-2 exiting, cacheEnabled=false 2024-04-27 03:00:56,798 INFO [Time-limited test-BucketCacheWriter-0] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-0 exiting, cacheEnabled=false 2024-04-27 03:00:56,806 INFO [Time-limited test-BucketCacheWriter-1] bucket.BucketCache$WriterThread(982): Time-limited test-BucketCacheWriter-1 exiting, cacheEnabled=false 2024-04-27 03:00:56,815 INFO [Time-limited test] hbase.ResourceChecker(175): after: io.hfile.TestHFile#testReaderWithLruCombinedBlockCache Thread=16 (was 15) Potentially hanging thread: Time-limited test-BucketCacheWriter-1 java.util.concurrent.locks.AbstractQueuedSynchronizer.enq(AbstractQueuedSynchronizer.java:587) java.util.concurrent.locks.AbstractQueuedSynchronizer.transferAfterCancelledWait(AbstractQueuedSynchronizer.java:1699) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.checkInterruptWhileWaiting(AbstractQueuedSynchronizer.java:2003) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2040) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:1156) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:968) - Thread LEAK? -, OpenFileDescriptor=294 (was 294), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=724 (was 724), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=1856 (was 1890)