2023-02-11 03:53:44,210 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.region.TestMasterRegionCompaction timeout: 13 mins 2023-02-11 03:53:44,251 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.region.TestMasterRegionCompaction#test Thread=7, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=4206 2023-02-11 03:53:44,285 INFO [Time-limited test] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 03:53:44,285 INFO [Time-limited test] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 03:53:44,849 INFO [Time-limited test] region.MasterRegion(309): Create or load local region for table 'test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 03:53:44,936 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 03:53:45,278 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 03:53:45,444 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 03:53:45,444 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 03:53:45,447 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-11 03:53:45,452 DEBUG [Time-limited test] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.createMasterRegion(MasterRegionTestBase.java:109) at org.apache.hadoop.hbase.master.region.MasterRegionTestBase.setUp(MasterRegionTestBase.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-02-11 03:53:45,456 INFO [Time-limited test] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 03:53:45,604 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 03:53:45,668 INFO [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 03:53:45,714 DEBUG [Time-limited test] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 03:53:45,724 INFO [Time-limited test] regionserver.HRegion(7689): Creating {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='test:local', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local-tmp 2023-02-11 03:53:45,816 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 03:53:45,906 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-11 03:53:45,906 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:45,907 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:45,908 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-11 03:53:45,908 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:45,908 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:45,909 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: Waiting for close lock at 1676087625906Disabling compacts and flushes for region at 1676087625906Disabling writes for close at 1676087625908 (+2 ms)Writing region close event to WAL at 1676087625908Closed at 1676087625908 2023-02-11 03:53:45,911 DEBUG [Time-limited test] region.MasterRegion(191): WALDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/WALs/localhost,12345,1676087624822 2023-02-11 03:53:45,935 INFO [Time-limited test] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=localhost%2C12345%2C1676087624822, suffix=, logDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/WALs/localhost,12345,1676087624822, archiveDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/oldWALs, maxLogs=32 2023-02-11 03:53:45,986 INFO [Time-limited test] wal.AbstractFSWAL(758): New WAL /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/WALs/localhost,12345,1676087624822/localhost%2C12345%2C1676087624822.1676087625947 2023-02-11 03:53:45,986 DEBUG [Time-limited test] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [] 2023-02-11 03:53:45,987 DEBUG [Time-limited test] regionserver.HRegion(7850): Opening region: {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''} 2023-02-11 03:53:45,987 DEBUG [Time-limited test] regionserver.HRegion(865): Instantiated test:local,,1.fb3251d5e68787855bc0679a918ea02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 03:53:45,990 DEBUG [Time-limited test] regionserver.HRegion(7890): checking encryption for fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:45,991 DEBUG [Time-limited test] regionserver.HRegion(7893): checking classloading for fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:46,045 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:46,047 WARN [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(529): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1. DEBUG log level might have more details. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-11 03:53:46,047 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-11 03:53:46,070 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f1 2023-02-11 03:53:46,084 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 03:53:46,084 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:46,085 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(532): Unable to set storagePolicy=HOT for path=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2 java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-11 03:53:46,085 DEBUG [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] util.CommonFSUtils(539): The underlying FileSystem implementation doesn't support setStoragePolicy. This is probably intentional on their part, since HDFS-9345 appears to be present in your version of Hadoop. For more information check the Hadoop documentation on 'ArchivalStorage', the Hadoop FileSystem specification docs from HADOOP-11981, and/or related documentation from the provider of the underlying FileSystem (its name should appear in the stacktrace that accompanies this message). Note in particular that Hadoop's local filesystem implementation doesn't support storage policies. java.lang.UnsupportedOperationException: RawLocalFileSystem doesn't support setStoragePolicy at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3041) at org.apache.hadoop.fs.FilterFileSystem.setStoragePolicy(FilterFileSystem.java:643) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:220) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6370) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1116) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1113) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-11 03:53:46,086 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3251d5e68787855bc0679a918ea02e columnFamilyName f2 2023-02-11 03:53:46,087 INFO [StoreOpener-fb3251d5e68787855bc0679a918ea02e-1] regionserver.HStore(310): Store=fb3251d5e68787855bc0679a918ea02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 03:53:46,090 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:46,091 DEBUG [Time-limited test] regionserver.HRegion(5208): Found 0 recovered edits file(s) under file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:46,103 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table test:local descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 03:53:46,105 DEBUG [Time-limited test] regionserver.HRegion(1054): writing seq id for fb3251d5e68787855bc0679a918ea02e 2023-02-11 03:53:46,111 DEBUG [Time-limited test] wal.WALSplitUtil(408): Wrote file=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 03:53:46,111 INFO [Time-limited test] regionserver.HRegion(1071): Opened fb3251d5e68787855bc0679a918ea02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72075251, jitterRate=0.07400493323802948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 03:53:46,111 DEBUG [Time-limited test] regionserver.HRegion(964): Region open journal for fb3251d5e68787855bc0679a918ea02e: Writing region info on filesystem at 1676087626016Initializing all the Stores at 1676087626016Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676087626017 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676087626017Cleaning up temporary data from old regions at 1676087626100 (+83 ms)Cleaning up detritus from prior splits at 1676087626100Region opened successfully at 1676087626111 (+11 ms) 2023-02-11 03:53:46,113 INFO [Time-limited test] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 03:53:46,126 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 03:53:46,127 INFO [Time-limited test] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 03:53:46,129 DEBUG [Time-limited test] cleaner.HFileCleaner(242): Starting for large file=Thread[Time-limited test-HFileCleaner.large.0-1676087626128,5,FailOnTimeoutGroup] 2023-02-11 03:53:46,129 DEBUG [Time-limited test] cleaner.HFileCleaner(257): Starting for small files=Thread[Time-limited test-HFileCleaner.small.0-1676087626129,5,FailOnTimeoutGroup] 2023-02-11 03:53:46,130 INFO [Time-limited test] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS is enabled. 2023-02-11 03:53:46,130 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:46,178 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-11 03:53:46,231 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 38f57a27bc2947e696b445059e18c6f7 2023-02-11 03:53:46,281 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/38f57a27bc2947e696b445059e18c6f7 2023-02-11 03:53:46,331 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 22db5c6fa86941c6ba280dafdba4d81d 2023-02-11 03:53:46,333 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=4 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/22db5c6fa86941c6ba280dafdba4d81d 2023-02-11 03:53:46,336 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/38f57a27bc2947e696b445059e18c6f7 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7 2023-02-11 03:53:46,338 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7, entries=1, sequenceid=4, filesize=4.8 K 2023-02-11 03:53:46,339 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/22db5c6fa86941c6ba280dafdba4d81d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d 2023-02-11 03:53:46,341 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d, entries=1, sequenceid=4, filesize=4.8 K 2023-02-11 03:53:46,343 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 165ms, sequenceid=4, compaction requested=false 2023-02-11 03:53:46,344 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-11 03:53:46,344 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-11 03:53:46,349 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 2202e0ebfa77442a9630141e7e5b1dc5 2023-02-11 03:53:46,353 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/2202e0ebfa77442a9630141e7e5b1dc5 2023-02-11 03:53:46,359 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 6bb71ac28c2444199b86b45de409ad64 2023-02-11 03:53:46,364 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=8 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/6bb71ac28c2444199b86b45de409ad64 2023-02-11 03:53:46,365 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/2202e0ebfa77442a9630141e7e5b1dc5 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5 2023-02-11 03:53:46,368 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5, entries=1, sequenceid=8, filesize=4.8 K 2023-02-11 03:53:46,368 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/6bb71ac28c2444199b86b45de409ad64 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64 2023-02-11 03:53:46,370 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64, entries=1, sequenceid=8, filesize=4.8 K 2023-02-11 03:53:46,371 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 27ms, sequenceid=8, compaction requested=false 2023-02-11 03:53:46,371 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-11 03:53:46,372 INFO [Time-limited test] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=62 B heapSize=752 B 2023-02-11 03:53:46,378 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 6effd93d5ab546629f636219b1c317c5 2023-02-11 03:53:46,384 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/6effd93d5ab546629f636219b1c317c5 2023-02-11 03:53:46,393 DEBUG [Time-limited test] hfile.HFile$WriterFactory(307): Unable to set drop behind on 6fed8610570d40efbae32d51b46448d1 2023-02-11 03:53:46,395 INFO [Time-limited test] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=12 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/6fed8610570d40efbae32d51b46448d1 2023-02-11 03:53:46,398 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/6effd93d5ab546629f636219b1c317c5 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5 2023-02-11 03:53:46,401 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5, entries=1, sequenceid=12, filesize=4.8 K 2023-02-11 03:53:46,402 DEBUG [Time-limited test] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/6fed8610570d40efbae32d51b46448d1 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1 2023-02-11 03:53:46,404 INFO [Time-limited test] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1, entries=1, sequenceid=12, filesize=4.8 K 2023-02-11 03:53:46,405 INFO [Time-limited test] regionserver.HRegion(2947): Finished flush of dataSize ~62 B/62, heapSize ~720 B/720, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 33ms, sequenceid=12, compaction requested=true 2023-02-11 03:53:46,406 DEBUG [Time-limited test] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-11 03:53:46,410 INFO [test:local-Flusher] regionserver.HRegion(2744): Flushing fb3251d5e68787855bc0679a918ea02e 2/2 column families, dataSize=31 B heapSize=632 B 2023-02-11 03:53:46,413 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 03:53:46,415 DEBUG [test:local-Flusher] hfile.HFile$WriterFactory(307): Unable to set drop behind on 93a5c19b8241421ca7f1cc8d2a0b7ca4 2023-02-11 03:53:46,416 INFO [test:local-Flusher] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=16 (bloomFilter=true), to=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4 2023-02-11 03:53:46,418 DEBUG [test:local-Flusher] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4 2023-02-11 03:53:46,420 INFO [test:local-Flusher] regionserver.HStore(1080): Added file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4, entries=1, sequenceid=16, filesize=4.8 K 2023-02-11 03:53:46,421 INFO [test:local-Flusher] regionserver.HRegion(2947): Finished flush of dataSize ~31 B/31, heapSize ~360 B/360, currentSize=0 B/0 for fb3251d5e68787855bc0679a918ea02e in 11ms, sequenceid=16, compaction requested=true 2023-02-11 03:53:46,421 DEBUG [test:local-Flusher] regionserver.HRegion(2445): Flush status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-11 03:53:46,423 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 03:53:46,425 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f1 is initiating major compaction (all files) 2023-02-11 03:53:46,425 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f1 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:46,426 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=19 K 2023-02-11 03:53:46,426 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 38f57a27bc2947e696b445059e18c6f7, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1676087626151 2023-02-11 03:53:46,427 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 2202e0ebfa77442a9630141e7e5b1dc5, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1676087626344 2023-02-11 03:53:46,427 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 6effd93d5ab546629f636219b1c317c5, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1676087626372 2023-02-11 03:53:46,427 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 93a5c19b8241421ca7f1cc8d2a0b7ca4, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1676087626409 2023-02-11 03:53:46,441 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on 3d331f6ac29442399f35ebb6c009184d 2023-02-11 03:53:46,446 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f1/3d331f6ac29442399f35ebb6c009184d as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/3d331f6ac29442399f35ebb6c009184d 2023-02-11 03:53:46,455 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 4 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f1 of fb3251d5e68787855bc0679a918ea02e into 3d331f6ac29442399f35ebb6c009184d(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 03:53:46,455 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-11 03:53:46,455 DEBUG [test:local-Store-Compactor] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 03:53:46,456 DEBUG [test:local-Store-Compactor] regionserver.HStore(1912): fb3251d5e68787855bc0679a918ea02e/f2 is initiating major compaction (all files) 2023-02-11 03:53:46,456 INFO [test:local-Store-Compactor] regionserver.HRegion(2258): Starting compaction of fb3251d5e68787855bc0679a918ea02e/f2 in test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:46,456 INFO [test:local-Store-Compactor] regionserver.HStore(1468): Starting compaction of [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1] into tmpdir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp, totalSize=14.3 K 2023-02-11 03:53:46,456 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 22db5c6fa86941c6ba280dafdba4d81d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=4, earliestPutTs=1676087626151 2023-02-11 03:53:46,456 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 6bb71ac28c2444199b86b45de409ad64, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1676087626344 2023-02-11 03:53:46,457 DEBUG [test:local-Store-Compactor] compactions.Compactor(207): Compacting 6fed8610570d40efbae32d51b46448d1, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1676087626372 2023-02-11 03:53:46,463 DEBUG [test:local-Store-Compactor] hfile.HFile$WriterFactory(307): Unable to set drop behind on a2cf3ea8d14043a287c590a620a1e681 2023-02-11 03:53:46,466 DEBUG [test:local-Store-Compactor] regionserver.HRegionFileSystem(485): Committing file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/.tmp/f2/a2cf3ea8d14043a287c590a620a1e681 as file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/a2cf3ea8d14043a287c590a620a1e681 2023-02-11 03:53:46,468 INFO [test:local-Store-Compactor] regionserver.HStore(1652): Completed major compaction of 3 (all) file(s) in fb3251d5e68787855bc0679a918ea02e/f2 of fb3251d5e68787855bc0679a918ea02e into a2cf3ea8d14043a287c590a620a1e681(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 03:53:46,468 DEBUG [test:local-Store-Compactor] regionserver.HRegion(2288): Compaction status journal for fb3251d5e68787855bc0679a918ea02e: 2023-02-11 03:53:46,468 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4] to archive 2023-02-11 03:53:46,471 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 03:53:46,473 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7 2023-02-11 03:53:46,473 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5 2023-02-11 03:53:46,474 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5 2023-02-11 03:53:46,474 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4 2023-02-11 03:53:46,492 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/2202e0ebfa77442a9630141e7e5b1dc5$-masterlocalhfile-$ 2023-02-11 03:53:46,493 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/93a5c19b8241421ca7f1cc8d2a0b7ca4$-masterlocalhfile-$ 2023-02-11 03:53:46,493 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/38f57a27bc2947e696b445059e18c6f7$-masterlocalhfile-$ 2023-02-11 03:53:46,494 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f1/6effd93d5ab546629f636219b1c317c5$-masterlocalhfile-$ 2023-02-11 03:53:46,494 DEBUG [test:local-Store-Compactor] regionserver.HStore(2712): Moving the files [file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1] to archive 2023-02-11 03:53:46,494 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 03:53:46,495 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d 2023-02-11 03:53:46,496 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64 2023-02-11 03:53:46,496 DEBUG [test:local-Store-Compactor] backup.HFileArchiver(582): Archived from FileableStoreFile, file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1 2023-02-11 03:53:46,498 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6bb71ac28c2444199b86b45de409ad64$-masterlocalhfile-$ 2023-02-11 03:53:46,499 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1 to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/6fed8610570d40efbae32d51b46448d1$-masterlocalhfile-$ 2023-02-11 03:53:46,499 INFO [test:local-Store-Compactor] region.MasterRegionUtils(50): Moved file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/local/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2874a1d6-eb61-f78b-64bd-5370a6011c4a/archive/data/test/local/fb3251d5e68787855bc0679a918ea02e/f2/22db5c6fa86941c6ba280dafdba4d81d$-masterlocalhfile-$ 2023-02-11 03:53:46,514 INFO [Time-limited test] hbase.Waiter(180): Waiting up to [15,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 03:53:46,641 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 11 ms. 2023-02-11 03:53:47,134 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:47,634 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-11 03:53:48,133 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:48,634 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:49,134 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 4 ms. 2023-02-11 03:53:49,634 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:50,133 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:50,633 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:51,133 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 3 ms. 2023-02-11 03:53:51,636 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 6 ms. 2023-02-11 03:53:52,132 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-11 03:53:52,632 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-11 03:53:53,132 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-11 03:53:53,632 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-11 03:53:54,131 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 1 ms. 2023-02-11 03:53:54,632 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 2 ms. 2023-02-11 03:53:55,130 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:55,630 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:56,130 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:56,630 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:57,130 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:57,630 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:58,130 DEBUG [TestMasterRegionCompaction.Chore.1] hbase.ScheduledChore(162): HFileCleaner execution time: 0 ms. 2023-02-11 03:53:58,520 INFO [Time-limited test] region.MasterRegion(167): Closing local region {ENCODED => fb3251d5e68787855bc0679a918ea02e, NAME => 'test:local,,1.fb3251d5e68787855bc0679a918ea02e.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-02-11 03:53:58,523 DEBUG [Time-limited test] regionserver.HRegion(1603): Closing fb3251d5e68787855bc0679a918ea02e, disabling compactions & flushes 2023-02-11 03:53:58,523 INFO [Time-limited test] regionserver.HRegion(1625): Closing region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:58,523 DEBUG [Time-limited test] regionserver.HRegion(1646): Waiting without time limit for close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:58,523 DEBUG [Time-limited test] regionserver.HRegion(1713): Acquired close lock on test:local,,1.fb3251d5e68787855bc0679a918ea02e. after waiting 0 ms 2023-02-11 03:53:58,524 DEBUG [Time-limited test] regionserver.HRegion(1723): Updates disabled for region test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:58,525 INFO [Time-limited test] regionserver.HRegion(1837): Closed test:local,,1.fb3251d5e68787855bc0679a918ea02e. 2023-02-11 03:53:58,526 DEBUG [Time-limited test] regionserver.HRegion(1557): Region close journal for fb3251d5e68787855bc0679a918ea02e: Waiting for close lock at 1676087638523Disabling compacts and flushes for region at 1676087638523Disabling writes for close at 1676087638524 (+1 ms)Writing region close event to WAL at 1676087638525 (+1 ms)Closed at 1676087638525 2023-02-11 03:53:58,526 INFO [test:local-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 03:53:58,526 INFO [Time-limited test] hbase.ChoreService(369): Chore service for: TestMasterRegionCompaction had [ScheduledChore name=HFileCleaner, period=500, unit=MILLISECONDS] on shutdown 2023-02-11 03:53:58,627 INFO [Time-limited test] hbase.ResourceChecker(175): after: master.region.TestMasterRegionCompaction#test Thread=14 (was 7) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.large.0-1676087626128 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Time-limited test-HFileCleaner.small.0-1676087626129 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) - Thread LEAK? -, OpenFileDescriptor=264 (was 260) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 252), ProcessCount=168 (was 168), AvailableMemoryMB=3948 (was 4206)