2023-03-09 02:54:00,978 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.region.TestMasterRegionCompaction timeout: 13 mins 2023-03-09 02:54:01,015 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.region.TestMasterRegionCompaction#test Thread=7, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=295, ProcessCount=170, AvailableMemoryMB=8737 2023-03-09 02:54:01,048 INFO [Time-limited test] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-09 02:54:01,048 INFO [Time-limited test] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-09 02:54:01,601 INFO [Time-limited test] region.MasterRegion(309): Create or load local region for table 'test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-09 02:54:01,696 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-09 02:54:02,044 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-09 02:54:02,206 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-09 02:54:02,206 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-09 02:54:02,209 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-03-09 02:54:02,214 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-03-09 02:54:02,219 INFO [Time-limited test] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-09 02:54:02,374 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-09 02:54:02,445 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-09 02:54:02,493 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-09 02:54:02,503 INFO [Time-limited test] regionserver.HRegion(7693): Creating {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local-tmp 2023-03-09 02:54:02,594 DEBUG [Time-limited test] regionserver.HRegion(866): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-09 02:54:02,689 DEBUG [Time-limited test] regionserver.HRegion(1604): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-03-09 02:54:02,689 INFO [Time-limited test] regionserver.HRegion(1626): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:02,689 DEBUG [Time-limited test] regionserver.HRegion(1647): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:02,690 DEBUG [Time-limited test] regionserver.HRegion(1714): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-03-09 02:54:02,691 DEBUG [Time-limited test] regionserver.HRegion(1724): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:02,691 INFO [Time-limited test] regionserver.HRegion(1838): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:02,691 DEBUG [Time-limited test] regionserver.HRegion(1558): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:02,694 DEBUG [Time-limited test] region.MasterRegion(191): WALDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/WALs/localhost,12345,1678330441573 2023-03-09 02:54:02,726 INFO [Time-limited test] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=localhost%2C12345%2C1678330441573, suffix=, logDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/WALs/localhost,12345,1678330441573, archiveDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/oldWALs, maxLogs=32 2023-03-09 02:54:02,782 INFO [Time-limited test] wal.AbstractFSWAL(758): New WAL /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/WALs/localhost,12345,1678330441573/localhost%2C12345%2C1678330441573.1678330442743 2023-03-09 02:54:02,783 DEBUG [Time-limited test] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [] 2023-03-09 02:54:02,783 DEBUG [Time-limited test] regionserver.HRegion(7854): Opening region: {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''} 2023-03-09 02:54:02,784 DEBUG [Time-limited test] regionserver.HRegion(866): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-09 02:54:02,788 DEBUG [Time-limited test] regionserver.HRegion(7894): checking encryption for fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,790 DEBUG [Time-limited test] regionserver.HRegion(7897): checking classloading for fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,869 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,871 WARN [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(529): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1. DEBUG log level might have more details. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6371) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1117) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1114) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-09 02:54:02,872 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6371) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1117) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1114) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-09 02:54:02,904 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f1 2023-03-09 02:54:02,925 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-09 02:54:02,926 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,927 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(532): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2 java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6371) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1117) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1114) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-09 02:54:02,927 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6371) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1117) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1114) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-09 02:54:02,929 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f2 2023-03-09 02:54:02,930 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-09 02:54:02,933 DEBUG [Time-limited test] regionserver.HRegion(5209): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,934 DEBUG [Time-limited test] regionserver.HRegion(5209): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,946 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table test:local descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-09 02:54:02,949 DEBUG [Time-limited test] regionserver.HRegion(1055): writing seq id for fb3251d5e68787855bc0679a918ea02e 2023-03-09 02:54:02,955 DEBUG [Time-limited test] wal.WALSplitUtil(408): Wrote file=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-09 02:54:02,957 INFO [Time-limited test] regionserver.HRegion(1072): Opened fb3251d5e68787855bc0679a918ea02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70452132, jitterRate=0.049818575382232666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-09 02:54:02,957 DEBUG [Time-limited test] regionserver.HRegion(965): Region open journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:02,959 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-09 02:54:02,979 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-09 02:54:02,980 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-09 02:54:02,982 DEBUG [Time-limited test] cleaner.HFileCleaner(242): Starting for large file=Thread[Time-limited test-HFileCleaner.large.0-1678330442982,5,FailOnTimeoutGroup] 2023-03-09 02:54:02,983 DEBUG [Time-limited test] cleaner.HFileCleaner(257): Starting for small files=Thread[Time-limited test-HFileCleaner.small.0-1678330442983,5,FailOnTimeoutGroup] 2023-03-09 02:54:02,983 INFO [Time-limited test] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS is enabled. 2023-03-09 02:54:02,984 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:03,036 INFO [Time-limited test] regionserver.HRegion(2745): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-03-09 02:54:03,089 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on abcb150edee84b02a14122561becc052 2023-03-09 02:54:03,132 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/abcb150edee84b02a14122561becc052 2023-03-09 02:54:03,183 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 05e49872f2bd465b9c18a700334d012d 2023-03-09 02:54:03,186 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/05e49872f2bd465b9c18a700334d012d 2023-03-09 02:54:03,190 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/abcb150edee84b02a14122561becc052 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052 2023-03-09 02:54:03,193 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052, entries=1, sequenceid=4, filesize=4.8 K 2023-03-09 02:54:03,195 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/05e49872f2bd465b9c18a700334d012d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d 2023-03-09 02:54:03,198 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d, entries=1, sequenceid=4, filesize=4.8 K 2023-03-09 02:54:03,200 INFO [Time-limited test] regionserver.HRegion(2948): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 164ms, sequenceid=4, compaction requested=false 2023-03-09 02:54:03,201 DEBUG [Time-limited test] regionserver.HRegion(2446): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:03,201 INFO [Time-limited test] regionserver.HRegion(2745): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-03-09 02:54:03,206 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 0f9dcc2d20464c26a6ef7d5eee734765 2023-03-09 02:54:03,209 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/0f9dcc2d20464c26a6ef7d5eee734765 2023-03-09 02:54:03,215 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 06ca842e512f4be8bfb73a2078d0ff8d 2023-03-09 02:54:03,217 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/06ca842e512f4be8bfb73a2078d0ff8d 2023-03-09 02:54:03,219 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/0f9dcc2d20464c26a6ef7d5eee734765 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765 2023-03-09 02:54:03,221 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765, entries=1, sequenceid=8, filesize=4.8 K 2023-03-09 02:54:03,221 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/06ca842e512f4be8bfb73a2078d0ff8d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d 2023-03-09 02:54:03,223 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d, entries=1, sequenceid=8, filesize=4.8 K 2023-03-09 02:54:03,224 INFO [Time-limited test] regionserver.HRegion(2948): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 23ms, sequenceid=8, compaction requested=false 2023-03-09 02:54:03,224 DEBUG [Time-limited test] regionserver.HRegion(2446): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:03,225 INFO [Time-limited test] regionserver.HRegion(2745): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-03-09 02:54:03,230 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 37187e938d094a5db5ebda330acecdbb 2023-03-09 02:54:03,231 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/37187e938d094a5db5ebda330acecdbb 2023-03-09 02:54:03,237 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on b12b6392455946098f11abd00965519d 2023-03-09 02:54:03,239 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/b12b6392455946098f11abd00965519d 2023-03-09 02:54:03,241 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/37187e938d094a5db5ebda330acecdbb as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb 2023-03-09 02:54:03,244 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb, entries=1, sequenceid=12, filesize=4.8 K 2023-03-09 02:54:03,244 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/b12b6392455946098f11abd00965519d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d 2023-03-09 02:54:03,246 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d, entries=1, sequenceid=12, filesize=4.8 K 2023-03-09 02:54:03,247 INFO [Time-limited test] regionserver.HRegion(2948): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 22ms, sequenceid=12, compaction requested=true 2023-03-09 02:54:03,247 DEBUG [Time-limited test] regionserver.HRegion(2446): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:03,250 INFO [test:local-Flusher] regionserver.HRegion(2745): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=31 B heapSize=632 B 2023-03-09 02:54:03,252 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-03-09 02:54:03,255 DEBUG [test:local-Flusher] hfile.HFile$WriterFactory(307): Unable to set drop behind on ede9a63488ce46d8a197406e43bd39db 2023-03-09 02:54:03,257 INFO [test:local-Flusher] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=16 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ede9a63488ce46d8a197406e43bd39db 2023-03-09 02:54:03,258 DEBUG [test:local-Flusher] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ede9a63488ce46d8a197406e43bd39db as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db 2023-03-09 02:54:03,260 INFO [test:local-Flusher] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db, entries=1, sequenceid=16, filesize=4.8 K 2023-03-09 02:54:03,261 INFO [test:local-Flusher] regionserver.HRegion(2948): Finished flush of dataSize ~31 B/31, heapSize ~360 B/360, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 11ms, sequenceid=16, compaction requested=true 2023-03-09 02:54:03,261 DEBUG [test:local-Flusher] regionserver.HRegion(2446): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:03,272 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-09 02:54:03,275 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f1 is initiating major compaction (all files) 2023-03-09 02:54:03,275 INFO [test:local-Store-Compactor] regionserver.HRegion(2259): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f1 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:03,276 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=19 K 2023-03-09 02:54:03,277 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting abcb150edee84b02a14122561becc052, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1678330443007 2023-03-09 02:54:03,278 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 0f9dcc2d20464c26a6ef7d5eee734765, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1678330443201 2023-03-09 02:54:03,278 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 37187e938d094a5db5ebda330acecdbb, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1678330443224 2023-03-09 02:54:03,278 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting ede9a63488ce46d8a197406e43bd39db, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1678330443250 2023-03-09 02:54:03,292 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on 27f0d7f63c284c63855c1a9d5362a416 2023-03-09 02:54:03,298 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/27f0d7f63c284c63855c1a9d5362a416 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/27f0d7f63c284c63855c1a9d5362a416 2023-03-09 02:54:03,307 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 4 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f1 of fb3251d5e68787855bc0679a918ea02e into 27f0d7f63c284c63855c1a9d5362a416(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-09 02:54:03,307 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2289): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:03,307 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-09 02:54:03,307 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f2 is initiating major compaction (all files) 2023-03-09 02:54:03,307 INFO [test:local-Store-Compactor] regionserver.HRegion(2259): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f2 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:03,307 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=14.3 K 2023-03-09 02:54:03,308 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 05e49872f2bd465b9c18a700334d012d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1678330443007 2023-03-09 02:54:03,308 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 06ca842e512f4be8bfb73a2078d0ff8d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1678330443201 2023-03-09 02:54:03,308 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting b12b6392455946098f11abd00965519d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1678330443224 2023-03-09 02:54:03,314 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on 54e59601d3c442a2991ed59e90dd7b0c 2023-03-09 02:54:03,317 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/54e59601d3c442a2991ed59e90dd7b0c as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/54e59601d3c442a2991ed59e90dd7b0c 2023-03-09 02:54:03,319 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 3 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f2 of fb3251d5e68787855bc0679a918ea02e into 54e59601d3c442a2991ed59e90dd7b0c(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-09 02:54:03,319 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2289): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:03,320 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db] to archive 2023-03-09 02:54:03,322 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-03-09 02:54:03,324 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052 2023-03-09 02:54:03,324 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765 2023-03-09 02:54:03,325 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb 2023-03-09 02:54:03,325 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db 2023-03-09 02:54:03,342 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ede9a63488ce46d8a197406e43bd39db$-masterlocalhfile-$ 2023-03-09 02:54:03,343 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/abcb150edee84b02a14122561becc052$-masterlocalhfile-$ 2023-03-09 02:54:03,343 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/0f9dcc2d20464c26a6ef7d5eee734765$-masterlocalhfile-$ 2023-03-09 02:54:03,344 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/37187e938d094a5db5ebda330acecdbb$-masterlocalhfile-$ 2023-03-09 02:54:03,344 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d] to archive 2023-03-09 02:54:03,344 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-03-09 02:54:03,345 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d 2023-03-09 02:54:03,346 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d 2023-03-09 02:54:03,347 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d 2023-03-09 02:54:03,350 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/06ca842e512f4be8bfb73a2078d0ff8d$-masterlocalhfile-$ 2023-03-09 02:54:03,350 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/b12b6392455946098f11abd00965519d$-masterlocalhfile-$ 2023-03-09 02:54:03,351 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3b9ebf7b-d31b-628c-e67f-420c1715f1f0/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/05e49872f2bd465b9c18a700334d012d$-masterlocalhfile-$ 2023-03-09 02:54:03,354 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-03-09 02:54:03,494 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 10 ms. 2023-03-09 02:54:03,987 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:04,487 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:04,987 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:05,486 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:05,986 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:06,486 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:06,986 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-09 02:54:07,486 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-09 02:54:07,987 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-09 02:54:08,489 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 6 ms. 2023-03-09 02:54:08,985 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-09 02:54:09,485 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-09 02:54:09,985 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-09 02:54:10,485 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-09 02:54:10,985 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-09 02:54:11,486 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-09 02:54:11,984 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:12,484 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:12,984 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:13,484 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:13,984 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:14,484 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:14,984 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-09 02:54:15,358 INFO [Time-limited test] region.MasterRegion(167): Closing local region {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-03-09 02:54:15,361 DEBUG [Time-limited test] regionserver.HRegion(1604): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-03-09 02:54:15,361 INFO [Time-limited test] regionserver.HRegion(1626): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:15,361 DEBUG [Time-limited test] regionserver.HRegion(1647): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:15,361 DEBUG [Time-limited test] regionserver.HRegion(1714): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-03-09 02:54:15,361 DEBUG [Time-limited test] regionserver.HRegion(1724): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:15,363 INFO [Time-limited test] regionserver.HRegion(1838): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-09 02:54:15,363 DEBUG [Time-limited test] regionserver.HRegion(1558): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-09 02:54:15,363 INFO [test:local-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-09 02:54:15,363 INFO [Time-limited test] hbase.ChoreService(369): Chore service for: TestMasterRegionCompaction had [ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS] on shutdown 2023-03-09 02:54:15,461 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.region.TestMasterRegionCompaction#test Thread=14 (was 7) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.small.0-1678330442983 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) Potentially hanging thread: Time-limited test-HFileCleaner.large.0-1678330442982 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=264 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 295), ProcessCount=170 (was 170), AvailableMemoryMB=8522 (was 8737)