2023-03-01 21:53:36,596 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.region.TestMasterRegionCompaction timeout: 13 mins 2023-03-01 21:53:36,647 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.region.TestMasterRegionCompaction#test Thread=7, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=328, ProcessCount=185, AvailableMemoryMB=9005 2023-03-01 21:53:36,680 INFO [Time-limited test] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-01 21:53:36,680 INFO [Time-limited test] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-01 21:53:37,256 INFO [Time-limited test] region.MasterRegion(309): Create or load local region for table 'test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-01 21:53:37,358 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-01 21:53:37,761 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-01 21:53:37,916 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-01 21:53:37,917 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-01 21:53:37,919 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-03-01 21:53:37,924 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-03-01 21:53:37,929 INFO [Time-limited test] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-01 21:53:38,075 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-01 21:53:38,162 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-01 21:53:38,220 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-01 21:53:38,230 INFO [Time-limited test] regionserver.HRegion(7689): Creating {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local-tmp 2023-03-01 21:53:38,350 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-01 21:53:38,470 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-03-01 21:53:38,471 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:38,471 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:38,472 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-03-01 21:53:38,472 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:38,473 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:38,473 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:38,475 DEBUG [Time-limited test] region.MasterRegion(191): WALDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/WALs/localhost,12345,1677707617226 2023-03-01 21:53:38,509 INFO [Time-limited test] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=localhost%2C12345%2C1677707617226, suffix=, logDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/WALs/localhost,12345,1677707617226, archiveDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/oldWALs, maxLogs=32 2023-03-01 21:53:38,584 INFO [Time-limited test] wal.AbstractFSWAL(758): New WAL /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/WALs/localhost,12345,1677707617226/localhost%2C12345%2C1677707617226.1677707618526 2023-03-01 21:53:38,585 DEBUG [Time-limited test] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [] 2023-03-01 21:53:38,586 DEBUG [Time-limited test] regionserver.HRegion(7850): Opening region: {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''} 2023-03-01 21:53:38,587 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-01 21:53:38,591 DEBUG [Time-limited test] regionserver.HRegion(7890): checking encryption for fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,592 DEBUG [Time-limited test] regionserver.HRegion(7893): checking classloading for fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,702 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,704 WARN [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(529): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1. DEBUG log level might have more details. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-01 21:53:38,704 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-01 21:53:38,736 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f1 2023-03-01 21:53:38,757 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-01 21:53:38,757 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,758 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(532): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2 java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-01 21:53:38,758 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-03-01 21:53:38,760 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f2 2023-03-01 21:53:38,761 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-01 21:53:38,765 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,766 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,778 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table test:local descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-01 21:53:38,781 DEBUG [Time-limited test] regionserver.HRegion(1054): writing seq id for fb3251d5e68787855bc0679a918ea02e 2023-03-01 21:53:38,790 DEBUG [Time-limited test] wal.WALSplitUtil(408): Wrote file=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-01 21:53:38,791 INFO [Time-limited test] regionserver.HRegion(1071): Opened fb3251d5e68787855bc0679a918ea02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62845829, jitterRate=-0.06352417171001434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-01 21:53:38,791 DEBUG [Time-limited test] regionserver.HRegion(964): Region open journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:38,792 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-01 21:53:38,807 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-01 21:53:38,808 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-01 21:53:38,810 DEBUG [Time-limited test] cleaner.HFileCleaner(242): Starting for large file=Thread[Time-limited test-HFileCleaner.large.0-1677707618809,5,FailOnTimeoutGroup] 2023-03-01 21:53:38,811 DEBUG [Time-limited test] cleaner.HFileCleaner(257): Starting for small files=Thread[Time-limited test-HFileCleaner.small.0-1677707618810,5,FailOnTimeoutGroup] 2023-03-01 21:53:38,811 INFO [Time-limited test] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS is enabled. 2023-03-01 21:53:38,811 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:38,868 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-03-01 21:53:38,928 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on cd926cfbdf65439fb41fddac13a122b7 2023-03-01 21:53:38,969 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/cd926cfbdf65439fb41fddac13a122b7 2023-03-01 21:53:39,016 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 429bf22d7034451eacfbd9dc3f2f7335 2023-03-01 21:53:39,019 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/429bf22d7034451eacfbd9dc3f2f7335 2023-03-01 21:53:39,021 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/cd926cfbdf65439fb41fddac13a122b7 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7 2023-03-01 21:53:39,023 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7, entries=1, sequenceid=4, filesize=4.8 K 2023-03-01 21:53:39,025 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/429bf22d7034451eacfbd9dc3f2f7335 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335 2023-03-01 21:53:39,028 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335, entries=1, sequenceid=4, filesize=4.8 K 2023-03-01 21:53:39,030 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 162ms, sequenceid=4, compaction requested=false 2023-03-01 21:53:39,032 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:39,033 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-03-01 21:53:39,041 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on a0b778b251dd41a4bd0484891371bdd6 2023-03-01 21:53:39,042 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/a0b778b251dd41a4bd0484891371bdd6 2023-03-01 21:53:39,053 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 504ee95eb11e489f9807b7b17060782d 2023-03-01 21:53:39,055 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/504ee95eb11e489f9807b7b17060782d 2023-03-01 21:53:39,058 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/a0b778b251dd41a4bd0484891371bdd6 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6 2023-03-01 21:53:39,061 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6, entries=1, sequenceid=8, filesize=4.8 K 2023-03-01 21:53:39,061 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/504ee95eb11e489f9807b7b17060782d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d 2023-03-01 21:53:39,064 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d, entries=1, sequenceid=8, filesize=4.8 K 2023-03-01 21:53:39,065 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 32ms, sequenceid=8, compaction requested=false 2023-03-01 21:53:39,066 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:39,066 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-03-01 21:53:39,074 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 03dc74789ef94f4992ae3578d9439ec3 2023-03-01 21:53:39,077 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/03dc74789ef94f4992ae3578d9439ec3 2023-03-01 21:53:39,083 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 600f4501a6b6433f8056515e4fe6fd27 2023-03-01 21:53:39,085 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/600f4501a6b6433f8056515e4fe6fd27 2023-03-01 21:53:39,088 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/03dc74789ef94f4992ae3578d9439ec3 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3 2023-03-01 21:53:39,090 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3, entries=1, sequenceid=12, filesize=4.8 K 2023-03-01 21:53:39,091 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/600f4501a6b6433f8056515e4fe6fd27 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27 2023-03-01 21:53:39,094 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27, entries=1, sequenceid=12, filesize=4.8 K 2023-03-01 21:53:39,095 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 29ms, sequenceid=12, compaction requested=true 2023-03-01 21:53:39,095 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:39,099 INFO [test:local-Flusher] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=31 B heapSize=632 B 2023-03-01 21:53:39,102 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-03-01 21:53:39,105 DEBUG [test:local-Flusher] hfile.HFile$WriterFactory(307): Unable to set drop behind on 4353cd06426642a5afbdc29091b8357c 2023-03-01 21:53:39,107 INFO [test:local-Flusher] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=16 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/4353cd06426642a5afbdc29091b8357c 2023-03-01 21:53:39,108 DEBUG [test:local-Flusher] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/4353cd06426642a5afbdc29091b8357c as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c 2023-03-01 21:53:39,110 INFO [test:local-Flusher] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c, entries=1, sequenceid=16, filesize=4.8 K 2023-03-01 21:53:39,111 INFO [test:local-Flusher] regionserver.HRegion(2947): Finished flush of dataSize ~31 B/31, heapSize ~360 B/360, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 12ms, sequenceid=16, compaction requested=true 2023-03-01 21:53:39,111 DEBUG [test:local-Flusher] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:39,114 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-01 21:53:39,116 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f1 is initiating major compaction (all files) 2023-03-01 21:53:39,117 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f1 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:39,117 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=19 K 2023-03-01 21:53:39,118 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting cd926cfbdf65439fb41fddac13a122b7, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1677707618832 2023-03-01 21:53:39,119 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting a0b778b251dd41a4bd0484891371bdd6, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1677707619032 2023-03-01 21:53:39,119 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 03dc74789ef94f4992ae3578d9439ec3, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1677707619066 2023-03-01 21:53:39,119 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 4353cd06426642a5afbdc29091b8357c, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1677707619098 2023-03-01 21:53:39,155 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on ec813fc3dbb44b368c30fc33fa924b47 2023-03-01 21:53:39,161 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/ec813fc3dbb44b368c30fc33fa924b47 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/ec813fc3dbb44b368c30fc33fa924b47 2023-03-01 21:53:39,170 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 4 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f1 of fb3251d5e68787855bc0679a918ea02e into ec813fc3dbb44b368c30fc33fa924b47(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-01 21:53:39,170 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:39,170 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-01 21:53:39,171 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f2 is initiating major compaction (all files) 2023-03-01 21:53:39,171 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f2 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:39,171 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=14.3 K 2023-03-01 21:53:39,171 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 429bf22d7034451eacfbd9dc3f2f7335, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1677707618832 2023-03-01 21:53:39,171 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 504ee95eb11e489f9807b7b17060782d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1677707619032 2023-03-01 21:53:39,172 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 600f4501a6b6433f8056515e4fe6fd27, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1677707619066 2023-03-01 21:53:39,178 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on c5d307d8942f4cb08c13f003778262df 2023-03-01 21:53:39,181 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/c5d307d8942f4cb08c13f003778262df as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/c5d307d8942f4cb08c13f003778262df 2023-03-01 21:53:39,184 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 3 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f2 of fb3251d5e68787855bc0679a918ea02e into c5d307d8942f4cb08c13f003778262df(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-01 21:53:39,184 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:39,185 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c] to archive 2023-03-01 21:53:39,187 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-03-01 21:53:39,189 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7 2023-03-01 21:53:39,190 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6 2023-03-01 21:53:39,190 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3 2023-03-01 21:53:39,191 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c 2023-03-01 21:53:39,204 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-03-01 21:53:39,212 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/4353cd06426642a5afbdc29091b8357c$-masterlocalhfile-$ 2023-03-01 21:53:39,213 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/cd926cfbdf65439fb41fddac13a122b7$-masterlocalhfile-$ 2023-03-01 21:53:39,213 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/a0b778b251dd41a4bd0484891371bdd6$-masterlocalhfile-$ 2023-03-01 21:53:39,214 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/03dc74789ef94f4992ae3578d9439ec3$-masterlocalhfile-$ 2023-03-01 21:53:39,214 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27] to archive 2023-03-01 21:53:39,235 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-03-01 21:53:39,235 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335 2023-03-01 21:53:39,236 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d 2023-03-01 21:53:39,237 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27 2023-03-01 21:53:39,239 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/504ee95eb11e489f9807b7b17060782d$-masterlocalhfile-$ 2023-03-01 21:53:39,239 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/600f4501a6b6433f8056515e4fe6fd27$-masterlocalhfile-$ 2023-03-01 21:53:39,240 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/956b90e5-e285-f062-637d-26fd53d050e1/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/429bf22d7034451eacfbd9dc3f2f7335$-masterlocalhfile-$ 2023-03-01 21:53:39,327 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 15 ms. 2023-03-01 21:53:39,815 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-01 21:53:40,316 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-03-01 21:53:40,815 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-01 21:53:41,314 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-01 21:53:41,814 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-01 21:53:42,314 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-03-01 21:53:42,814 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-01 21:53:43,314 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-01 21:53:43,814 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-01 21:53:44,316 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 5 ms. 2023-03-01 21:53:44,813 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-01 21:53:45,312 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-01 21:53:45,812 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-01 21:53:46,312 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-01 21:53:46,812 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-03-01 21:53:47,314 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-03-01 21:53:47,811 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:48,311 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:48,811 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:49,311 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:49,811 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:50,311 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:50,811 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:51,309 INFO [Time-limited test] region.MasterRegion(167): Closing local region {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-03-01 21:53:51,311 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-03-01 21:53:51,312 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-03-01 21:53:51,312 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:51,312 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:51,312 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-03-01 21:53:51,312 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:51,314 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-03-01 21:53:51,314 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: 2023-03-01 21:53:51,315 INFO [test:local-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-01 21:53:51,315 INFO [Time-limited test] hbase.ChoreService(369): Chore service for: TestMasterRegionCompaction had [ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS] on shutdown 2023-03-01 21:53:51,405 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.region.TestMasterRegionCompaction#test Thread=14 (was 7) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.large.0-1677707618809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.small.0-1677707618810 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) - Thread LEAK? -, OpenFileDescriptor=264 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=345 (was 328) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 185), AvailableMemoryMB=8200 (was 9005)