2023-02-26 02:53:35,702 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.region.TestMasterRegionCompaction timeout: 13 mins 2023-02-26 02:53:35,741 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.region.TestMasterRegionCompaction#test Thread=7, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=396, ProcessCount=173, AvailableMemoryMB=9403 2023-02-26 02:53:35,781 INFO [Time-limited test] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-26 02:53:35,781 INFO [Time-limited test] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-26 02:53:36,372 INFO [Time-limited test] region.MasterRegion(309): Create or load local region for table 'test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-26 02:53:36,478 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-26 02:53:36,897 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-26 02:53:37,071 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-26 02:53:37,071 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-26 02:53:37,074 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-26 02:53:37,080 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-26 02:53:37,084 INFO [Time-limited test] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-26 02:53:37,249 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-26 02:53:37,345 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-26 02:53:37,399 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-26 02:53:37,410 INFO [Time-limited test] regionserver.HRegion(7689): Creating {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local-tmp 2023-02-26 02:53:37,506 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-26 02:53:37,587 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-26 02:53:37,587 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:37,587 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:37,588 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-26 02:53:37,588 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:37,588 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:37,589 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:37,591 DEBUG [Time-limited test] region.MasterRegion(191): WALDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/WALs/localhost,12345,1677380016343 2023-02-26 02:53:37,627 INFO [Time-limited test] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=localhost%2C12345%2C1677380016343, suffix=, logDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/WALs/localhost,12345,1677380016343, archiveDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/oldWALs, maxLogs=32 2023-02-26 02:53:37,698 INFO [Time-limited test] wal.AbstractFSWAL(758): New WAL /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/WALs/localhost,12345,1677380016343/localhost%2C12345%2C1677380016343.1677380017644 2023-02-26 02:53:37,699 DEBUG [Time-limited test] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [] 2023-02-26 02:53:37,699 DEBUG [Time-limited test] regionserver.HRegion(7850): Opening region: {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''} 2023-02-26 02:53:37,700 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-26 02:53:37,703 DEBUG [Time-limited test] regionserver.HRegion(7890): checking encryption for fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,704 DEBUG [Time-limited test] regionserver.HRegion(7893): checking classloading for fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,774 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,776 WARN [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(529): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1. DEBUG log level might have more details. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-26 02:53:37,777 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-26 02:53:37,808 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f1 2023-02-26 02:53:37,828 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-26 02:53:37,829 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,830 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(532): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2 java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-26 02:53:37,830 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-26 02:53:37,832 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f2 2023-02-26 02:53:37,832 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-26 02:53:37,837 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,838 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,857 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table test:local descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-26 02:53:37,860 DEBUG [Time-limited test] regionserver.HRegion(1054): writing seq id for fb3251d5e68787855bc0679a918ea02e 2023-02-26 02:53:37,869 DEBUG [Time-limited test] wal.WALSplitUtil(408): Wrote file=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-26 02:53:37,870 INFO [Time-limited test] regionserver.HRegion(1071): Opened fb3251d5e68787855bc0679a918ea02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59172925, jitterRate=-0.11825470626354218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-26 02:53:37,870 DEBUG [Time-limited test] regionserver.HRegion(964): Region open journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:37,871 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-26 02:53:37,892 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-26 02:53:37,893 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-26 02:53:37,895 DEBUG [Time-limited test] cleaner.HFileCleaner(242): Starting for large file=Thread[Time-limited test-HFileCleaner.large.0-1677380017895,5,FailOnTimeoutGroup] 2023-02-26 02:53:37,896 DEBUG [Time-limited test] cleaner.HFileCleaner(257): Starting for small files=Thread[Time-limited test-HFileCleaner.small.0-1677380017895,5,FailOnTimeoutGroup] 2023-02-26 02:53:37,897 INFO [Time-limited test] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS is enabled. 2023-02-26 02:53:37,897 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:37,952 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-26 02:53:38,007 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on ce89d26a2a8c4ae293a9f4cf80af1117 2023-02-26 02:53:38,052 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ce89d26a2a8c4ae293a9f4cf80af1117 2023-02-26 02:53:38,104 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 6b5bdc6f404f4bdabdbfc818db788f64 2023-02-26 02:53:38,108 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/6b5bdc6f404f4bdabdbfc818db788f64 2023-02-26 02:53:38,111 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ce89d26a2a8c4ae293a9f4cf80af1117 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117 2023-02-26 02:53:38,115 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117, entries=1, sequenceid=4, filesize=4.8 K 2023-02-26 02:53:38,116 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/6b5bdc6f404f4bdabdbfc818db788f64 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64 2023-02-26 02:53:38,120 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64, entries=1, sequenceid=4, filesize=4.8 K 2023-02-26 02:53:38,122 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 170ms, sequenceid=4, compaction requested=false 2023-02-26 02:53:38,123 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:38,124 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-26 02:53:38,131 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 5c6ecd1f0fad4a45ae4dd7d9e769ee30 2023-02-26 02:53:38,133 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30 2023-02-26 02:53:38,140 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 74406b15a0974383b16f352833a00e2b 2023-02-26 02:53:38,143 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/74406b15a0974383b16f352833a00e2b 2023-02-26 02:53:38,145 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30 2023-02-26 02:53:38,148 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30, entries=1, sequenceid=8, filesize=4.8 K 2023-02-26 02:53:38,150 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/74406b15a0974383b16f352833a00e2b as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b 2023-02-26 02:53:38,154 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b, entries=1, sequenceid=8, filesize=4.8 K 2023-02-26 02:53:38,155 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 31ms, sequenceid=8, compaction requested=false 2023-02-26 02:53:38,155 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:38,156 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-26 02:53:38,167 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 50b9aac0e76647d18f99b2934ab81355 2023-02-26 02:53:38,170 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/50b9aac0e76647d18f99b2934ab81355 2023-02-26 02:53:38,181 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 99567d86bff143a38f02a0832104dd46 2023-02-26 02:53:38,183 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/99567d86bff143a38f02a0832104dd46 2023-02-26 02:53:38,186 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/50b9aac0e76647d18f99b2934ab81355 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355 2023-02-26 02:53:38,189 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355, entries=1, sequenceid=12, filesize=4.8 K 2023-02-26 02:53:38,189 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/99567d86bff143a38f02a0832104dd46 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46 2023-02-26 02:53:38,192 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46, entries=1, sequenceid=12, filesize=4.8 K 2023-02-26 02:53:38,193 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 37ms, sequenceid=12, compaction requested=true 2023-02-26 02:53:38,193 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:38,197 INFO [test:local-Flusher] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=31 B heapSize=632 B 2023-02-26 02:53:38,200 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-26 02:53:38,217 DEBUG [test:local-Flusher] hfile.HFile$WriterFactory(307): Unable to set drop behind on 983581bd0adb45049c9f004802f7cb19 2023-02-26 02:53:38,219 INFO [test:local-Flusher] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=16 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/983581bd0adb45049c9f004802f7cb19 2023-02-26 02:53:38,221 DEBUG [test:local-Flusher] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/983581bd0adb45049c9f004802f7cb19 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19 2023-02-26 02:53:38,222 INFO [test:local-Flusher] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19, entries=1, sequenceid=16, filesize=4.8 K 2023-02-26 02:53:38,224 INFO [test:local-Flusher] regionserver.HRegion(2947): Finished flush of dataSize ~31 B/31, heapSize ~360 B/360, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 27ms, sequenceid=16, compaction requested=true 2023-02-26 02:53:38,224 DEBUG [test:local-Flusher] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:38,228 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-26 02:53:38,230 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f1 is initiating major compaction (all files) 2023-02-26 02:53:38,231 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f1 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:38,231 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=19 K 2023-02-26 02:53:38,232 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting ce89d26a2a8c4ae293a9f4cf80af1117, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1677380017919 2023-02-26 02:53:38,233 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 5c6ecd1f0fad4a45ae4dd7d9e769ee30, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1677380018123 2023-02-26 02:53:38,233 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 50b9aac0e76647d18f99b2934ab81355, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1677380018156 2023-02-26 02:53:38,234 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 983581bd0adb45049c9f004802f7cb19, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1677380018196 2023-02-26 02:53:38,252 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on 77182b0c25394caebb3e56b633e5dda8 2023-02-26 02:53:38,261 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/77182b0c25394caebb3e56b633e5dda8 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/77182b0c25394caebb3e56b633e5dda8 2023-02-26 02:53:38,273 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 4 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f1 of fb3251d5e68787855bc0679a918ea02e into 77182b0c25394caebb3e56b633e5dda8(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-26 02:53:38,274 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:38,274 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-26 02:53:38,274 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f2 is initiating major compaction (all files) 2023-02-26 02:53:38,274 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f2 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:38,274 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=14.3 K 2023-02-26 02:53:38,275 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 6b5bdc6f404f4bdabdbfc818db788f64, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1677380017919 2023-02-26 02:53:38,275 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 74406b15a0974383b16f352833a00e2b, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1677380018123 2023-02-26 02:53:38,276 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 99567d86bff143a38f02a0832104dd46, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1677380018156 2023-02-26 02:53:38,286 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on c9a872ba61e14f71a2438eb71129aadb 2023-02-26 02:53:38,289 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/c9a872ba61e14f71a2438eb71129aadb as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/c9a872ba61e14f71a2438eb71129aadb 2023-02-26 02:53:38,292 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 3 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f2 of fb3251d5e68787855bc0679a918ea02e into c9a872ba61e14f71a2438eb71129aadb(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-26 02:53:38,292 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:38,292 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19] to archive 2023-02-26 02:53:38,295 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-26 02:53:38,297 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117 2023-02-26 02:53:38,297 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30 2023-02-26 02:53:38,298 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355 2023-02-26 02:53:38,299 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19 2023-02-26 02:53:38,301 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-26 02:53:38,318 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ce89d26a2a8c4ae293a9f4cf80af1117$-masterlocalhfile-$ 2023-02-26 02:53:38,319 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/983581bd0adb45049c9f004802f7cb19$-masterlocalhfile-$ 2023-02-26 02:53:38,320 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/5c6ecd1f0fad4a45ae4dd7d9e769ee30$-masterlocalhfile-$ 2023-02-26 02:53:38,321 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/50b9aac0e76647d18f99b2934ab81355$-masterlocalhfile-$ 2023-02-26 02:53:38,322 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46] to archive 2023-02-26 02:53:38,322 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-26 02:53:38,323 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64 2023-02-26 02:53:38,324 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b 2023-02-26 02:53:38,325 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46 2023-02-26 02:53:38,328 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/99567d86bff143a38f02a0832104dd46$-masterlocalhfile-$ 2023-02-26 02:53:38,329 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6b5bdc6f404f4bdabdbfc818db788f64$-masterlocalhfile-$ 2023-02-26 02:53:38,330 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/db4b5c49-ebe5-9de6-336f-81b82359c35c/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/74406b15a0974383b16f352833a00e2b$-masterlocalhfile-$ 2023-02-26 02:53:38,414 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 17 ms. 2023-02-26 02:53:38,902 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-26 02:53:39,402 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 5 ms. 2023-02-26 02:53:39,901 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-26 02:53:40,401 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-26 02:53:40,902 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-26 02:53:41,401 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-26 02:53:41,901 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-26 02:53:42,401 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-26 02:53:42,901 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-26 02:53:43,403 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 6 ms. 2023-02-26 02:53:43,899 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-26 02:53:44,399 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-26 02:53:44,899 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-26 02:53:45,398 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-26 02:53:45,898 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-26 02:53:46,398 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-26 02:53:46,900 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-26 02:53:47,397 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:47,897 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:48,397 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:48,897 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:49,397 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:49,897 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:50,397 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-26 02:53:50,410 INFO [Time-limited test] region.MasterRegion(167): Closing local region {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-02-26 02:53:50,414 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-26 02:53:50,414 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:50,414 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:50,414 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-26 02:53:50,414 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:50,434 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-26 02:53:50,434 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-26 02:53:50,434 INFO [test:local-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-26 02:53:50,435 INFO [Time-limited test] hbase.ChoreService(369): Chore service for: TestMasterRegionCompaction had [ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS] on shutdown 2023-02-26 02:53:50,578 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.region.TestMasterRegionCompaction#test Thread=14 (was 7) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.large.0-1677380017895 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.small.0-1677380017895 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) - Thread LEAK? -, OpenFileDescriptor=264 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=344 (was 396), ProcessCount=173 (was 173), AvailableMemoryMB=8394 (was 9403)