2023-02-17 20:53:30,656 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.region.TestMasterRegionCompaction timeout: 13 mins 2023-02-17 20:53:30,697 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.region.TestMasterRegionCompaction#test Thread=7, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=173, AvailableMemoryMB=9014 2023-02-17 20:53:30,742 INFO [Time-limited test] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 20:53:30,743 INFO [Time-limited test] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 20:53:31,352 INFO [Time-limited test] region.MasterRegion(309): Create or load local region for table 'test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 20:53:31,469 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-17 20:53:31,878 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 20:53:32,078 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-17 20:53:32,078 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-17 20:53:32,081 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-17 20:53:32,089 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-17 20:53:32,095 INFO [Time-limited test] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 20:53:32,250 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-17 20:53:32,334 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-17 20:53:32,400 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-17 20:53:32,411 INFO [Time-limited test] regionserver.HRegion(7689): Creating {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local-tmp 2023-02-17 20:53:32,507 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 20:53:32,597 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-17 20:53:32,598 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:32,598 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:32,599 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-17 20:53:32,599 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:32,599 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:32,599 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:32,602 DEBUG [Time-limited test] region.MasterRegion(191): WALDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/WALs/localhost,12345,1676667211313 2023-02-17 20:53:32,631 INFO [Time-limited test] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=localhost%2C12345%2C1676667211313, suffix=, logDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/WALs/localhost,12345,1676667211313, archiveDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/oldWALs, maxLogs=32 2023-02-17 20:53:32,695 INFO [Time-limited test] wal.AbstractFSWAL(758): New WAL /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/WALs/localhost,12345,1676667211313/localhost%2C12345%2C1676667211313.1676667212644 2023-02-17 20:53:32,695 DEBUG [Time-limited test] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [] 2023-02-17 20:53:32,696 DEBUG [Time-limited test] regionserver.HRegion(7850): Opening region: {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''} 2023-02-17 20:53:32,697 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 20:53:32,701 DEBUG [Time-limited test] regionserver.HRegion(7890): checking encryption for fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,702 DEBUG [Time-limited test] regionserver.HRegion(7893): checking classloading for fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,769 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,770 WARN [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(529): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1. DEBUG log level might have more details. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-17 20:53:32,771 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-17 20:53:32,794 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f1 2023-02-17 20:53:32,810 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 20:53:32,810 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,811 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(532): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2 java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-17 20:53:32,812 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-17 20:53:32,813 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f2 2023-02-17 20:53:32,814 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 20:53:32,818 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,819 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,834 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table test:local descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 20:53:32,837 DEBUG [Time-limited test] regionserver.HRegion(1054): writing seq id for fb3251d5e68787855bc0679a918ea02e 2023-02-17 20:53:32,845 DEBUG [Time-limited test] wal.WALSplitUtil(408): Wrote file=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 20:53:32,846 INFO [Time-limited test] regionserver.HRegion(1071): Opened fb3251d5e68787855bc0679a918ea02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63749048, jitterRate=-0.05006515979766846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 20:53:32,846 DEBUG [Time-limited test] regionserver.HRegion(964): Region open journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:32,848 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 20:53:32,863 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 20:53:32,864 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 20:53:32,865 DEBUG [Time-limited test] cleaner.HFileCleaner(242): Starting for large file=Thread[Time-limited test-HFileCleaner.large.0-1676667212865,5,FailOnTimeoutGroup] 2023-02-17 20:53:32,870 DEBUG [Time-limited test] cleaner.HFileCleaner(257): Starting for small files=Thread[Time-limited test-HFileCleaner.small.0-1676667212866,5,FailOnTimeoutGroup] 2023-02-17 20:53:32,870 INFO [Time-limited test] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS is enabled. 2023-02-17 20:53:32,870 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:32,922 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-17 20:53:32,973 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 40dfa535fcac40c795f90d3c3389fb21 2023-02-17 20:53:33,017 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/40dfa535fcac40c795f90d3c3389fb21 2023-02-17 20:53:33,075 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 1ea817d00d234495a9b917944d0a48f9 2023-02-17 20:53:33,079 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/1ea817d00d234495a9b917944d0a48f9 2023-02-17 20:53:33,082 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/40dfa535fcac40c795f90d3c3389fb21 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21 2023-02-17 20:53:33,086 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21, entries=1, sequenceid=4, filesize=4.8 K 2023-02-17 20:53:33,088 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/1ea817d00d234495a9b917944d0a48f9 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9 2023-02-17 20:53:33,091 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9, entries=1, sequenceid=4, filesize=4.8 K 2023-02-17 20:53:33,093 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 171ms, sequenceid=4, compaction requested=false 2023-02-17 20:53:33,094 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:33,096 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-17 20:53:33,105 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 73b8dc2ecb57448fa7cbb1ecbe05b76b 2023-02-17 20:53:33,108 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b 2023-02-17 20:53:33,117 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 7b9d1097a0c64d86b79b271c4cb7dc93 2023-02-17 20:53:33,120 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/7b9d1097a0c64d86b79b271c4cb7dc93 2023-02-17 20:53:33,123 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b 2023-02-17 20:53:33,126 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b, entries=1, sequenceid=8, filesize=4.8 K 2023-02-17 20:53:33,127 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/7b9d1097a0c64d86b79b271c4cb7dc93 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93 2023-02-17 20:53:33,131 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93, entries=1, sequenceid=8, filesize=4.8 K 2023-02-17 20:53:33,134 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 38ms, sequenceid=8, compaction requested=false 2023-02-17 20:53:33,134 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:33,135 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-17 20:53:33,144 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on ac57bd6d90bd4c74b58d5e2cc29df678 2023-02-17 20:53:33,147 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ac57bd6d90bd4c74b58d5e2cc29df678 2023-02-17 20:53:33,157 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 180ed7ddcc1d46b3b3b1ee0743e04d13 2023-02-17 20:53:33,160 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/180ed7ddcc1d46b3b3b1ee0743e04d13 2023-02-17 20:53:33,164 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ac57bd6d90bd4c74b58d5e2cc29df678 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678 2023-02-17 20:53:33,167 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678, entries=1, sequenceid=12, filesize=4.8 K 2023-02-17 20:53:33,168 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/180ed7ddcc1d46b3b3b1ee0743e04d13 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13 2023-02-17 20:53:33,171 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13, entries=1, sequenceid=12, filesize=4.8 K 2023-02-17 20:53:33,172 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 37ms, sequenceid=12, compaction requested=true 2023-02-17 20:53:33,172 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:33,183 INFO [test:local-Flusher] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=31 B heapSize=632 B 2023-02-17 20:53:33,186 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 20:53:33,212 DEBUG [test:local-Flusher] hfile.HFile$WriterFactory(307): Unable to set drop behind on f51d183e700f43429d214e6e57890469 2023-02-17 20:53:33,215 INFO [test:local-Flusher] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=16 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/f51d183e700f43429d214e6e57890469 2023-02-17 20:53:33,217 DEBUG [test:local-Flusher] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/f51d183e700f43429d214e6e57890469 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469 2023-02-17 20:53:33,220 INFO [test:local-Flusher] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469, entries=1, sequenceid=16, filesize=4.8 K 2023-02-17 20:53:33,221 INFO [test:local-Flusher] regionserver.HRegion(2947): Finished flush of dataSize ~31 B/31, heapSize ~360 B/360, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 38ms, sequenceid=16, compaction requested=true 2023-02-17 20:53:33,221 DEBUG [test:local-Flusher] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:33,225 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-17 20:53:33,227 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f1 is initiating major compaction (all files) 2023-02-17 20:53:33,228 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f1 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:33,228 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=19 K 2023-02-17 20:53:33,229 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 40dfa535fcac40c795f90d3c3389fb21, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1676667212893 2023-02-17 20:53:33,230 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 73b8dc2ecb57448fa7cbb1ecbe05b76b, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1676667213095 2023-02-17 20:53:33,230 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting ac57bd6d90bd4c74b58d5e2cc29df678, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1676667213134 2023-02-17 20:53:33,230 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting f51d183e700f43429d214e6e57890469, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1676667213176 2023-02-17 20:53:33,273 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on 372624598ab34cbbaf35a248178eb787 2023-02-17 20:53:33,280 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/372624598ab34cbbaf35a248178eb787 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/372624598ab34cbbaf35a248178eb787 2023-02-17 20:53:33,289 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 4 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f1 of fb3251d5e68787855bc0679a918ea02e into 372624598ab34cbbaf35a248178eb787(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-17 20:53:33,289 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:33,289 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-17 20:53:33,290 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f2 is initiating major compaction (all files) 2023-02-17 20:53:33,290 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f2 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:33,290 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=14.3 K 2023-02-17 20:53:33,290 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 1ea817d00d234495a9b917944d0a48f9, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1676667212893 2023-02-17 20:53:33,291 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 7b9d1097a0c64d86b79b271c4cb7dc93, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1676667213095 2023-02-17 20:53:33,291 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 180ed7ddcc1d46b3b3b1ee0743e04d13, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1676667213134 2023-02-17 20:53:33,302 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on bfc02e282e004438852d4b80eecb24bd 2023-02-17 20:53:33,306 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/bfc02e282e004438852d4b80eecb24bd as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/bfc02e282e004438852d4b80eecb24bd 2023-02-17 20:53:33,309 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 3 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f2 of fb3251d5e68787855bc0679a918ea02e into bfc02e282e004438852d4b80eecb24bd(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-17 20:53:33,309 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:33,309 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469] to archive 2023-02-17 20:53:33,313 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-17 20:53:33,315 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21 2023-02-17 20:53:33,316 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b 2023-02-17 20:53:33,317 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678 2023-02-17 20:53:33,317 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469 2023-02-17 20:53:33,342 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/73b8dc2ecb57448fa7cbb1ecbe05b76b$-masterlocalhfile-$ 2023-02-17 20:53:33,342 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/40dfa535fcac40c795f90d3c3389fb21$-masterlocalhfile-$ 2023-02-17 20:53:33,343 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ac57bd6d90bd4c74b58d5e2cc29df678$-masterlocalhfile-$ 2023-02-17 20:53:33,344 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/f51d183e700f43429d214e6e57890469$-masterlocalhfile-$ 2023-02-17 20:53:33,344 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13] to archive 2023-02-17 20:53:33,345 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-17 20:53:33,346 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9 2023-02-17 20:53:33,346 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93 2023-02-17 20:53:33,347 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13 2023-02-17 20:53:33,349 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/1ea817d00d234495a9b917944d0a48f9$-masterlocalhfile-$ 2023-02-17 20:53:33,350 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/7b9d1097a0c64d86b79b271c4cb7dc93$-masterlocalhfile-$ 2023-02-17 20:53:33,351 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e33343be-7439-def6-7814-c851129527b3/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/180ed7ddcc1d46b3b3b1ee0743e04d13$-masterlocalhfile-$ 2023-02-17 20:53:33,384 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 13 ms. 2023-02-17 20:53:33,388 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 20:53:33,876 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 5 ms. 2023-02-17 20:53:34,375 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-17 20:53:34,874 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-17 20:53:35,373 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-17 20:53:35,875 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-17 20:53:36,374 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-17 20:53:36,873 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-17 20:53:37,374 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-17 20:53:37,873 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-17 20:53:38,376 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 5 ms. 2023-02-17 20:53:38,872 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-17 20:53:39,373 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-17 20:53:39,872 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-17 20:53:40,372 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-17 20:53:40,872 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-17 20:53:41,372 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-17 20:53:41,873 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-17 20:53:42,371 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:42,871 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:43,371 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:43,871 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:44,371 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:44,871 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:45,371 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-17 20:53:45,393 INFO [Time-limited test] region.MasterRegion(167): Closing local region {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-02-17 20:53:45,396 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-17 20:53:45,397 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:45,397 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:45,397 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-17 20:53:45,397 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:45,399 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-17 20:53:45,399 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-17 20:53:45,400 INFO [test:local-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 20:53:45,400 INFO [Time-limited test] hbase.ChoreService(369): Chore service for: TestMasterRegionCompaction had [ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS] on shutdown 2023-02-17 20:53:45,536 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.region.TestMasterRegionCompaction#test Thread=14 (was 7) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.large.0-1676667212865 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.small.0-1676667212866 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) - Thread LEAK? -, OpenFileDescriptor=264 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 312), ProcessCount=171 (was 173), AvailableMemoryMB=8025 (was 9014)