2023-02-15 12:53:30,411 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.region.TestMasterRegionCompaction timeout: 13 mins 2023-02-15 12:53:30,454 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.region.TestMasterRegionCompaction#test Thread=7, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=168, AvailableMemoryMB=4961 2023-02-15 12:53:30,495 INFO [Time-limited test] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 12:53:30,495 INFO [Time-limited test] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 12:53:31,086 INFO [Time-limited test] region.MasterRegion(309): Create or load local region for table 'test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 12:53:31,197 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-15 12:53:31,579 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 12:53:31,746 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-15 12:53:31,746 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-15 12:53:31,749 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-15 12:53:31,754 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-15 12:53:31,759 INFO [Time-limited test] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 12:53:31,939 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-15 12:53:32,020 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-15 12:53:32,069 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-15 12:53:32,080 INFO [Time-limited test] regionserver.HRegion(7689): Creating {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local-tmp 2023-02-15 12:53:32,195 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 12:53:32,282 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-15 12:53:32,283 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:32,283 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:32,284 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-15 12:53:32,284 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:32,284 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:32,285 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,286 DEBUG [Time-limited test] region.MasterRegion(191): WALDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/WALs/localhost,12345,1676465611057 2023-02-15 12:53:32,315 INFO [Time-limited test] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=localhost%2C12345%2C1676465611057, suffix=, logDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/WALs/localhost,12345,1676465611057, archiveDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/oldWALs, maxLogs=32 2023-02-15 12:53:32,387 INFO [Time-limited test] wal.AbstractFSWAL(758): New WAL /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/WALs/localhost,12345,1676465611057/localhost%2C12345%2C1676465611057.1676465612330 2023-02-15 12:53:32,388 DEBUG [Time-limited test] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [] 2023-02-15 12:53:32,389 DEBUG [Time-limited test] regionserver.HRegion(7850): Opening region: {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''} 2023-02-15 12:53:32,389 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 12:53:32,394 DEBUG [Time-limited test] regionserver.HRegion(7890): checking encryption for fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,395 DEBUG [Time-limited test] regionserver.HRegion(7893): checking classloading for fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,472 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,474 WARN [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(529): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1. DEBUG log level might have more details. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-15 12:53:32,474 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-15 12:53:32,499 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f1 2023-02-15 12:53:32,515 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 12:53:32,515 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,516 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(532): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2 java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-15 12:53:32,516 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-15 12:53:32,517 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f2 2023-02-15 12:53:32,518 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 12:53:32,521 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,522 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,538 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table test:local descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 12:53:32,540 DEBUG [Time-limited test] regionserver.HRegion(1054): writing seq id for fb3251d5e68787855bc0679a918ea02e 2023-02-15 12:53:32,546 DEBUG [Time-limited test] wal.WALSplitUtil(408): Wrote file=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 12:53:32,547 INFO [Time-limited test] regionserver.HRegion(1071): Opened fb3251d5e68787855bc0679a918ea02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65768013, jitterRate=-0.019980236887931824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 12:53:32,547 DEBUG [Time-limited test] regionserver.HRegion(964): Region open journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,548 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 12:53:32,564 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 12:53:32,565 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 12:53:32,566 DEBUG [Time-limited test] cleaner.HFileCleaner(242): Starting for large file=Thread[Time-limited test-HFileCleaner.large.0-1676465612566,5,FailOnTimeoutGroup] 2023-02-15 12:53:32,567 DEBUG [Time-limited test] cleaner.HFileCleaner(257): Starting for small files=Thread[Time-limited test-HFileCleaner.small.0-1676465612567,5,FailOnTimeoutGroup] 2023-02-15 12:53:32,567 INFO [Time-limited test] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS is enabled. 2023-02-15 12:53:32,567 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:32,629 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-15 12:53:32,699 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 4d6524b4173d4eb49838b77eb6e0ff7e 2023-02-15 12:53:32,748 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/4d6524b4173d4eb49838b77eb6e0ff7e 2023-02-15 12:53:32,797 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 9d7414a8c06b4189b73069e000399bdf 2023-02-15 12:53:32,799 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/9d7414a8c06b4189b73069e000399bdf 2023-02-15 12:53:32,801 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/4d6524b4173d4eb49838b77eb6e0ff7e as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e 2023-02-15 12:53:32,803 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e, entries=1, sequenceid=4, filesize=4.8 K 2023-02-15 12:53:32,804 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/9d7414a8c06b4189b73069e000399bdf as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf 2023-02-15 12:53:32,806 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf, entries=1, sequenceid=4, filesize=4.8 K 2023-02-15 12:53:32,808 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 179ms, sequenceid=4, compaction requested=false 2023-02-15 12:53:32,809 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,811 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-15 12:53:32,816 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 2f321bd423ee46e590c57dc24ab29c63 2023-02-15 12:53:32,819 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/2f321bd423ee46e590c57dc24ab29c63 2023-02-15 12:53:32,829 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 47cfa5fbcf8141f5aca55a3b4c632775 2023-02-15 12:53:32,832 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/47cfa5fbcf8141f5aca55a3b4c632775 2023-02-15 12:53:32,834 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/2f321bd423ee46e590c57dc24ab29c63 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63 2023-02-15 12:53:32,837 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63, entries=1, sequenceid=8, filesize=4.8 K 2023-02-15 12:53:32,838 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/47cfa5fbcf8141f5aca55a3b4c632775 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775 2023-02-15 12:53:32,841 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775, entries=1, sequenceid=8, filesize=4.8 K 2023-02-15 12:53:32,842 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 31ms, sequenceid=8, compaction requested=false 2023-02-15 12:53:32,842 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,843 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-15 12:53:32,850 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on b2e43de7d84b443f98ee5e2c2216a5c1 2023-02-15 12:53:32,852 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/b2e43de7d84b443f98ee5e2c2216a5c1 2023-02-15 12:53:32,858 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 27b6398c822e46389e64228ac74a5b9d 2023-02-15 12:53:32,860 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/27b6398c822e46389e64228ac74a5b9d 2023-02-15 12:53:32,862 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/b2e43de7d84b443f98ee5e2c2216a5c1 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1 2023-02-15 12:53:32,864 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1, entries=1, sequenceid=12, filesize=4.8 K 2023-02-15 12:53:32,865 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/27b6398c822e46389e64228ac74a5b9d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d 2023-02-15 12:53:32,866 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d, entries=1, sequenceid=12, filesize=4.8 K 2023-02-15 12:53:32,867 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 24ms, sequenceid=12, compaction requested=true 2023-02-15 12:53:32,867 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,871 INFO [test:local-Flusher] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=31 B heapSize=632 B 2023-02-15 12:53:32,873 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 12:53:32,877 DEBUG [test:local-Flusher] hfile.HFile$WriterFactory(307): Unable to set drop behind on e475b3f0bed447fbbd43af1df55271c1 2023-02-15 12:53:32,879 INFO [test:local-Flusher] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=16 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/e475b3f0bed447fbbd43af1df55271c1 2023-02-15 12:53:32,881 DEBUG [test:local-Flusher] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/e475b3f0bed447fbbd43af1df55271c1 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1 2023-02-15 12:53:32,883 INFO [test:local-Flusher] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1, entries=1, sequenceid=16, filesize=4.8 K 2023-02-15 12:53:32,884 INFO [test:local-Flusher] regionserver.HRegion(2947): Finished flush of dataSize ~31 B/31, heapSize ~360 B/360, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 13ms, sequenceid=16, compaction requested=true 2023-02-15 12:53:32,884 DEBUG [test:local-Flusher] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,887 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-15 12:53:32,889 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f1 is initiating major compaction (all files) 2023-02-15 12:53:32,889 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f1 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:32,890 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=19 K 2023-02-15 12:53:32,890 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 4d6524b4173d4eb49838b77eb6e0ff7e, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1676465612597 2023-02-15 12:53:32,891 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 2f321bd423ee46e590c57dc24ab29c63, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1676465612810 2023-02-15 12:53:32,891 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting b2e43de7d84b443f98ee5e2c2216a5c1, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1676465612843 2023-02-15 12:53:32,891 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting e475b3f0bed447fbbd43af1df55271c1, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1676465612870 2023-02-15 12:53:32,907 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on 9a2e3efc9f0c4a4aaad6ef292b1a5337 2023-02-15 12:53:32,913 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/9a2e3efc9f0c4a4aaad6ef292b1a5337 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/9a2e3efc9f0c4a4aaad6ef292b1a5337 2023-02-15 12:53:32,923 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 4 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f1 of fb3251d5e68787855bc0679a918ea02e into 9a2e3efc9f0c4a4aaad6ef292b1a5337(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-15 12:53:32,923 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,923 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-15 12:53:32,923 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f2 is initiating major compaction (all files) 2023-02-15 12:53:32,924 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f2 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:32,924 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=14.3 K 2023-02-15 12:53:32,924 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 9d7414a8c06b4189b73069e000399bdf, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1676465612597 2023-02-15 12:53:32,924 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 47cfa5fbcf8141f5aca55a3b4c632775, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1676465612810 2023-02-15 12:53:32,925 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 27b6398c822e46389e64228ac74a5b9d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1676465612843 2023-02-15 12:53:32,945 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on d1dd68a9bbe24927a3ab3a5ac35acdba 2023-02-15 12:53:32,950 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/d1dd68a9bbe24927a3ab3a5ac35acdba as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/d1dd68a9bbe24927a3ab3a5ac35acdba 2023-02-15 12:53:32,955 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 3 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f2 of fb3251d5e68787855bc0679a918ea02e into d1dd68a9bbe24927a3ab3a5ac35acdba(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-15 12:53:32,955 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:32,956 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1] to archive 2023-02-15 12:53:32,960 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-15 12:53:32,962 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e 2023-02-15 12:53:32,963 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63 2023-02-15 12:53:32,964 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1 2023-02-15 12:53:32,965 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1 2023-02-15 12:53:32,974 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 12:53:32,995 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/e475b3f0bed447fbbd43af1df55271c1$-masterlocalhfile-$ 2023-02-15 12:53:32,996 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/b2e43de7d84b443f98ee5e2c2216a5c1$-masterlocalhfile-$ 2023-02-15 12:53:32,996 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2f321bd423ee46e590c57dc24ab29c63$-masterlocalhfile-$ 2023-02-15 12:53:32,997 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4d6524b4173d4eb49838b77eb6e0ff7e$-masterlocalhfile-$ 2023-02-15 12:53:32,997 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d] to archive 2023-02-15 12:53:32,998 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-15 12:53:32,998 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf 2023-02-15 12:53:32,999 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775 2023-02-15 12:53:33,000 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d 2023-02-15 12:53:33,002 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/9d7414a8c06b4189b73069e000399bdf$-masterlocalhfile-$ 2023-02-15 12:53:33,002 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/47cfa5fbcf8141f5aca55a3b4c632775$-masterlocalhfile-$ 2023-02-15 12:53:33,003 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d82dd11a-2202-3f1e-ff99-ae176868273c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/27b6398c822e46389e64228ac74a5b9d$-masterlocalhfile-$ 2023-02-15 12:53:33,080 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 12 ms. 2023-02-15 12:53:33,574 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 6 ms. 2023-02-15 12:53:34,072 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-15 12:53:34,571 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-15 12:53:35,071 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-15 12:53:35,571 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-15 12:53:36,072 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-15 12:53:36,571 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-15 12:53:37,071 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-15 12:53:37,571 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-15 12:53:38,073 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 6 ms. 2023-02-15 12:53:38,569 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-15 12:53:39,069 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-15 12:53:39,569 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-15 12:53:40,069 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-15 12:53:40,569 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-15 12:53:41,069 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-15 12:53:41,570 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-15 12:53:42,068 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:42,568 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:43,068 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:43,567 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:44,068 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:44,568 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:45,067 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-15 12:53:45,080 INFO [Time-limited test] region.MasterRegion(167): Closing local region {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-02-15 12:53:45,083 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-15 12:53:45,083 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:45,083 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:45,083 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-15 12:53:45,083 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:45,086 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-15 12:53:45,086 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-15 12:53:45,086 INFO [test:local-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 12:53:45,086 INFO [Time-limited test] hbase.ChoreService(369): Chore service for: TestMasterRegionCompaction had [ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS] on shutdown 2023-02-15 12:53:45,183 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.region.TestMasterRegionCompaction#test Thread=14 (was 7) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.large.0-1676465612566 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.small.0-1676465612567 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) - Thread LEAK? -, OpenFileDescriptor=264 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 360), ProcessCount=168 (was 168), AvailableMemoryMB=4009 (was 4961)